System, a computer readable medium, and a method for providing an integrated management of message information

ABSTRACT

A mobile device providing integrated management of message information and service provision through artificial intelligence is disclosed. The mobile device includes an integrated message management unit comprising a message monitoring unit configured to monitor voice call information and text message information in association with the voice call management part and the text message management part, a message information managing unit configured to generate integrated message information, which is to be provided to a user, based on the voice call information and the text message information, an interface managing unit configured to generate an integrated message management user interface displaying the integrated message information, and an artificial intelligence agent analyzing the voice call information and the text message information and providing a service associated with at least one additional function in association with the additional function process part based on the analyzed result.

CROSS REFERENCE TO RELATED APPLICATION

This application claims priority from and the benefit of Korean PatentApplication No. 10-2017-0040405, filed on Mar. 30, 2017, which is herebyincorporated by reference for all purposes as if fully set forth herein.

BACKGROUND Field

Exemplary embodiments of the invention relate generally to an apparatusand method for managing information on voice calls and text messagesexchanged through a mobile telephone switching network, and morespecifically, to an apparatus and a method for providing an integratedmessage management service that manages information on a voice call anda text message.

Discussion of the Background

A mobile telephone system supports voice calls and the exchange of textmessages between mobile terminals. Recently, smartphones have sent andreceived voice calls and text messages through the mobile phoneswitching network. A smartphone generally has a voice call managementapplication for controlling the voice call function and managing voicecall information, such as the time of receiving and sending a voicecall, the counterpart (i.e., caller) information (phone number orcontact name) of the voice call, total call duration, etc. The user canexecute the voice call management application to inquire the voice callhistory and the detailed information of the voice call, and delete theinquired voice call information. On the other hand, a smartphonegenerally also has a text message management application that controls atext message function and stores information, for example, the time forreceiving and sending a text message, the counterpart (i.e., persontexting) information (phone number or contact name) of the text message,contents of the text message, etc. The user can execute the text messagemanagement application to inquire the text message history and thedetailed information of the text message, and delete the inquired textmessage information.

However, since the voice call application and the text messageapplication in a conventional smartphone are executed independently, thevoice call information and the text message information cannot bemanaged at once. In addition, the conventional voice call applicationand the text message application do not provide any additional functionsother than its functions of receiving/transmitting a voice call/textmessage and managing voice call/text message information. Therefore,even when a user desires other additional functions in association withvoice calls and text messages sent and received by the user, it may bedifficult to immediately execute the additional functions.

The above information disclosed in this Background section is only forunderstanding of the background of the inventive concepts, and,therefore, it may contain information that does not constitute priorart.

SUMMARY

Exemplary embodiments of the present invention provide a method and amobile device for providing a user interface for managing voice callinformation and text message information.

Additional features of the inventive concepts will be set forth in thedescription which follows, and in part will be apparent from thedescription, or may be learned by practice of the inventive concepts.

An exemplary embodiment provides a mobile communication devicecomprising a voice call management part configured to manage a voicecall, a text message management part configured to manage text messagesexchanged through a mobile telephone switching network, a display part,an integrated message management unit, and an additional functionprocess part configured to process at least one additional function inassociation with the integrated message management unit. The integratedmessage management unit may comprise a message monitoring unitconfigured to monitor voice call information and text messageinformation in association with the voice call management part and thetext message management part, a message information managing unitconfigured to generate integrated message information, which is to beprovided to a user, based on the voice call information and the textmessage information, an interface managing unit configured to generatean integrated message management user interface displaying theintegrated message information, and an artificial intelligence agentanalyzing the voice call information and the text message informationand providing a service associated with at least one additional functionin association with the additional function processing unit based on theanalyzed result.

Another exemplary embodiment provides a method, performed by anartificial agent of a mobile device, for creating a schedule based onanalysis of incoming and outgoing message, the method comprisesperforming morpheme analysis and speech act analysis on a first messagetransmitted or received by the mobile device, determining whether thefirst message is a message for arranging a schedule, extracting entitiesconstituting a schedule from the first message to generate scheduleinformation and temporarily storing the schedule information,determining whether the first message is a notification of a fixedschedule using the result of the morpheme analysis and speech actanalysis, and registering the schedule information when the firstmessage is determined as a notification of a fixed schedule.

The foregoing general description and the following detailed descriptionare exemplary and explanatory and are intended to provide furtherexplanation of the claimed subject matter.

It is to be understood that both the foregoing general description andthe following detailed description are exemplary and explanatory and areintended to provide further explanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this specification, illustrate exemplary embodiments of theinvention, and together with the description serve to explain theinventive concepts.

FIG. 1 is a block diagram illustrating a configuration of an integratedmessage management service system according to an exemplary embodimentof the present invention.

FIG. 2 is a block diagram illustrating a configuration of a mobileterminal according to an exemplary embodiment of the present invention.

FIG. 3 is a detailed block diagram illustrating a mobile terminalaccording to an exemplary embodiment of the present invention.

FIG. 4 is a screenshot illustrating an example of a first messagemanagement user interface displayed on a mobile terminal.

FIG. 5 is a flowchart illustrating a process for generating a firstmessage management user interface having the configuration shown in FIG.4.

FIG. 6 is a flowchart illustrating a process of generating a secondmessage management user interface.

FIG. 7 is a screenshot showing an example of a second message managementuser interface provided by the integrated message management part.

FIG. 8 is a block diagram illustrating an artificial intelligence (AI)agent according to an exemplary embodiment of the present invention.

FIG. 9 is a flow chart illustrating a general process of a serviceperformed by an AI agent according to an exemplary embodiment of thepresent invention.

FIG. 10 is a flowchart illustrating a process for generating scheduleinformation performed by an AI agent according to an exemplaryembodiment of the present invention.

FIG. 11 is a screen shot showing a second message management userinterface displaying a dialog between the user of the mobile terminaland a friend of the user.

FIG. 12 is a screen shot showing an example of a schedule informationregistration graphical user interface capable of receiving a user inputfor approval and rejection of registering schedule information.

FIG. 13 is an exemplary screenshot of a first message management userinterface 100 where a first event panel is displayed.

FIG. 14 is a flowchart illustrating a process for generating a firstevent panel according to an exemplary embodiment of the presentinvention.

FIG. 15 is a flowchart illustrating a process for generating a firstevent panel according to an exemplary embodiment of the presentinvention.

FIG. 16 is a flowchart showing processes for generating anauthentication code copy interface.

FIG. 17 is a flowchart illustrating a process for generating anauthentication code copy interface.

FIG. 18 is a screenshot illustrating an example of the authenticationcode copy interface provided by the present invention.

FIG. 19 is a block diagram illustrating an integrated message managementservice server configured according to a first system configurationaccording to an exemplary embodiment of the present invention.

FIG. 20 is a block diagram illustrating an integrated message managementservice server configured according to the second system configurationaccording to an exemplary embodiment of the present invention.

FIG. 21 is a block diagram illustrating a mobile terminal configuredaccording to a second system configuration according to an exemplaryembodiment of the present invention.

DETAILED DESCRIPTION

In the following description, for the purposes of explanation, numerousspecific details are set forth in order to provide a thoroughunderstanding of various exemplary embodiments or implementations of theinvention. As used herein “embodiments” and “implementations” areinterchangeable words that are non-limiting examples of devices ormethods employing one or more of the inventive concepts disclosedherein. It is apparent, however, that various exemplary embodiments maybe practiced without these specific details or with one or moreequivalent arrangements. In other instances, well-known structures anddevices are shown in block diagram form in order to avoid unnecessarilyobscuring various exemplary embodiments. Further, various exemplaryembodiments may be different, but do not have to be exclusive. Forexample, specific shapes, configurations, and characteristics of anexemplary embodiment may be used or implemented in another exemplaryembodiment without departing from the inventive concepts.

Unless otherwise specified, the illustrated exemplary embodiments are tobe understood as providing exemplary features of varying detail of someways in which the inventive concepts may be implemented in practice.Therefore, unless otherwise specified, the features, components,modules, layers, films, panels, regions, and/or aspects, etc.(hereinafter individually or collectively referred to as “elements”), ofthe various embodiments may be otherwise combined, separated,interchanged, and/or rearranged without departing from the inventiveconcepts.

The use of cross-hatching and/or shading in the accompanying drawings isgenerally provided to clarify boundaries between adjacent elements. Assuch, neither the presence nor the absence of cross-hatching or shadingconveys or indicates any preference or requirement for particularmaterials, material properties, dimensions, proportions, commonalitiesbetween illustrated elements, and/or any other characteristic,attribute, property, etc., of the elements, unless specified. Further,in the accompanying drawings, the size and relative sizes of elementsmay be exaggerated for clarity and/or descriptive purposes. When anexemplary embodiment may be implemented differently, a specific processorder may be performed differently from the described order. Forexample, two consecutively described processes may be performedsubstantially at the same time or performed in an order opposite to thedescribed order. Also, like reference numerals denote like elements.

When an element, such as a layer, is referred to as being “on,”“connected to,” or “coupled to” another element or layer, it may bedirectly on, connected to, or coupled to the other element or layer orintervening elements or layers may be present. When, however, an elementor layer is referred to as being “directly on,” “directly connected to,”or “directly coupled to” another element or layer, there are nointervening elements or layers present. To this end, the term“connected” may refer to physical, electrical, and/or fluid connection,with or without intervening elements. Further, the D1-axis, the D2-axis,and the D3-axis are not limited to three axes of a rectangularcoordinate system, such as the x, y, and z—axes, and may be interpretedin a broader sense. For example, the D1-axis, the D2-axis, and theD3-axis may be perpendicular to one another, or may represent differentdirections that are not perpendicular to one another. For the purposesof this disclosure, “at least one of X, Y, and Z” and “at least oneselected from the group consisting of X, Y, and Z” may be construed as Xonly, Y only, Z only, or any combination of two or more of X, Y, and Z,such as, for instance, XYZ, XYY, YZ, and ZZ. As used herein, the term“and/or” includes any and all combinations of one or more of theassociated listed items.

Although the terms “first,” “second,” etc. may be used herein todescribe various types of elements, these elements should not be limitedby these terms. These terms are used to distinguish one element fromanother element. Thus, a first element discussed below could be termed asecond element without departing from the teachings of the disclosure.

Spatially relative terms, such as “beneath,” “below,” “under,” “lower,”“above,” “upper,” “over,” “higher,” “side” (e.g., as in “sidewall”), andthe like, may be used herein for descriptive purposes, and, thereby, todescribe one elements relationship to another element(s) as illustratedin the drawings. Spatially relative terms are intended to encompassdifferent orientations of an apparatus in use, operation, and/ormanufacture in addition to the orientation depicted in the drawings. Forexample, if the apparatus in the drawings is turned over, elementsdescribed as “below” or “beneath” other elements or features would thenbe oriented “above” the other elements or features. Thus, the exemplaryterm “below” can encompass both an orientation of above and below.Furthermore, the apparatus may be otherwise oriented (e.g., rotated 90degrees or at other orientations), and, as such, the spatially relativedescriptors used herein interpreted accordingly.

The terminology used herein is for the purpose of describing particularembodiments and is not intended to be limiting. As used herein, thesingular forms, “a,” “an,” and “the” are intended to include the pluralforms as well, unless the context clearly indicates otherwise. Moreover,the terms “comprises,” “comprising,” “includes,” and/or “including,”when used in this specification, specify the presence of statedfeatures, integers, steps, operations, elements, components, and/orgroups thereof, but do not preclude the presence or addition of one ormore other features, integers, steps, operations, elements, components,and/or groups thereof. It is also noted that, as used herein, the terms“substantially,” “about,” and other similar terms, are used as terms ofapproximation and not as terms of degree, and, as such, are utilized toaccount for inherent deviations in measured, calculated, and/or providedvalues that would be recognized by one of ordinary skill in the art.

In exemplary embodiments, one or more components thereof, includingcomponents described as a “part”, may be implemented via one or moregeneral purpose and/or special purpose components, such as one or morediscrete circuits, digital signal processing chips, integrated circuits,application specific integrated circuits, microprocessors, processors,programmable arrays, field programmable arrays, instruction setprocessors, and/or the like.

According to one or more exemplary embodiments, the parts, features,functions, processes, etc., described herein may be implemented viasoftware, hardware (e.g., general processor, digital signal processing(DSP) chip, an application specific integrated circuit (ASIC), fieldprogrammable gate arrays (FPGAs), etc.), firmware, or a combinationthereof. In this manner, one or more components thereof may include orotherwise be associated with one or more memories (not shown) includingcode (e.g., instructions) configured to cause information management,and/or one or more components thereof to perform one or more of theparts, features, functions, processes, etc., described herein.

The memories may be any medium that participates in providing code tothe one or more software, hardware, and/or firmware components forexecution. Such memories may be implemented in any suitable form,including, but not limited to, non-volatile media, volatile media, andtransmission media. Non-volatile media include, for example, optical ormagnetic disks. Volatile media include dynamic memory. Transmissionmedia include coaxial cables, copper wire and fiber optics. Transmissionmedia can also take the form of acoustic, optical, or electromagneticwaves. Common forms of computer-readable media include, for example, afloppy disk, a flexible disk, hard disk, magnetic tape, any othermagnetic medium, a compact disk-read only memory (CD-ROM), a rewriteablecompact disk (CD-RW), a digital video disk (DVD), a rewriteable DVD(DVD-RW), any other optical medium, punch cards, paper tape, opticalmark sheets, any other physical medium with patterns of holes or otheroptically recognizable indicia, a random-access memory (RAM), aprogrammable read only memory (PROM), and erasable programmable readonly memory (EPROM), a FLASH-EPROM, any other memory chip or cartridge,a carrier wave, or any other medium from which information may be readby, for example, a controller/processor.

Unless otherwise defined, all terms (including technical and scientificterms) used herein have the same meaning as commonly understood by oneof ordinary skill in the art to which this disclosure is a part. Terms,such as those defined in commonly used dictionaries, should beinterpreted as having a meaning that is consistent with their meaning inthe context of the relevant art and should not be interpreted in anidealized or overly formal sense, unless expressly so defined herein.

FIG. 1 is a block diagram illustrating a configuration of an integratedmessage management service system according to an exemplary embodimentof the present invention.

The integrated management service system according to an exemplaryembodiment may include a plurality of mobile terminals 10, an integratedmessage management service server 20, and data communication network 30.The mobile terminals 10 and the integrated message management serviceserver 20 may be in communication with each other to transmit signals ordata for providing an integrated message information management servicevia the data communication network 30. The mobile terminal 10 may be atelecommunication device that may transmit and receive a voice call anda text message via a communication network, and exchange data viawireless communication network. The mobile terminal 10 may include adisplay device configured to display various graphical user interfaces.

An integrated message management service system according to anexemplary embodiment of the present invention may have various systemconfigurations. Hereinafter, an integrated message informationmanagement system and an integrated message information managementservice provided by the system will be described with reference toexemplary embodiments of the present invention.

FIG. 2 is a block diagram illustrating a configuration of a mobileterminal according to an exemplary embodiment of the present invention.

The mobile terminal 10 according to an exemplary embodiment of thepresent invention includes a voice call management part 1100, a textmessage management part 1200, an additional function process part 1300,an integrated message management part 1400, a memory 1500, and atransceiver 1600. Additional input/output elements may also be includedin terminal 10, including but not limited to a speaker, microphone,switch, touch sensor, keyboard, trackball, pen, camera, LED light, etc.

The voice call management part 1100 may be software, hardware, or acombination of hardware and software, each of which is configured toprocess a voice call exchanged through the mobile-phone switchingnetwork, and to manage information on the voice call (hereinafter,referred to as “voice call information”). The voice call information mayinclude, for example, a receiving and transmitting time of a voice call,a counterpart (phone number or contact name) information of a voicecall, a total call time, success or failure of the voice callconnection, and the like. The voice call management part 1100 collectsthe voice call information on all of the voice calls received ortransmitted by the mobile terminal 10 and stores the voice callinformation. The management of the voice call information may beperformed in conjunction with an address book management applicationinstalled in the mobile terminal 10. For example, if calleridentification (CID) is included in the incoming voice call, thereceived CID is compared with the phone numbers stored in the addressbook. If the same number is stored in the address book, the voice callinformation management part 1100 retrieves the contact name of the CIDand records it in the voice call information. Otherwise, the phonenumber (CID) is recorded in the voice call information.

The text message management part 1200 may be software, hardware, or acombination of hardware and software, which is configured totransmit/receive a text message exchanged through a mobile telephoneswitching network, such as a Short Message Service (SMS) and aMultimedia Messaging Service (MMS), and to manage information about atext message (hereinafter, “text message information”). The text messageinformation managed by the text message management part 1200 mayinclude, for example, a receiving and transmitting time, areceiver/sender (phone number), content of the text message, and thelike. In addition, management of the text message information may beperformed in cooperation with an address book application installed inthe mobile terminal 10. For example, if there is caller identification(CID) included in the received text message, the received CID iscompared with the phone numbers stored in the address book. If the samenumber is stored in the address book, the text message management part1200 retrieves a contact name having the CID and records the contactname in the text message information. Otherwise, the phone number (CID)is recorded in the text message information.

The transceiver 1600 performs a function of receiving and transmitting avoice call and a text message through the mobile telephone switchingnetwork. The transceiver 1600 typically may also function to receive andtransmit signals related to packet data communication, other than voicecommunication and text messages, through a wireless data communicationnetwork.

The additional function process part 1300 may be hardware, software, ora combination of hardware and software configured to provide variousadditional functions. For example, the additional function process part1300 may be a combination of software including instructions necessaryfor performing the additional functions, and a processor performingprocesses according to the instructions. At this time, the software, asa part of the additional function process part 1300, may be installed inthe mobile terminal 10 in a form of an application. The additionalfunction process part 1300 may be configured to perform one or morefunctions. Hereinafter, the operation of the additional function processpart 1300 will be described for each function.

The mobile terminal 10 according to an exemplary embodiment of thepresent invention may include a schedule information managementapplication, as an exemplary part of the additional function processpart 1300. The schedule information management application is configuredto manage schedule information of the user. The schedule informationmanagement application may provide a schedule management user interfacethrough which a user creates, modifies, and deletes his or her schedule.The schedule information input through the schedule management userinterface may include, for example, a scheduled date and time, a place,a scheduled entry, and the like. The schedule information is stored in amemory 1500.

The mobile terminal 10 according to an exemplary embodiment of thepresent invention may include a memo application as an example of theadditional function process part 1300. The memo application provides amemo user interface for creating, modifying, deleting, and viewing amemo, and stores the created memo in the memory 1500 of the mobileterminal 10.

The mobile terminal 10 according to an exemplary embodiment of thepresent invention may include a social network service (SNS) applicationas an example of the additional function process part 1300. An SNSapplication is used to share a variety of content over a data networkfor social relationships among multiple users.

The above-mentioned additional functions may be provided by anadditional function process part 1300 embedded in the integrated messagemanagement part 1400.

The integrated message management part 1400 manages voice callinformation and text message information in association with the voicecall management part 1100 and the text message management part 1200, andprovides an additional function in association with the additionalfunction process part 1300 (e.g., a schedule information managementapplication, a memo managing unit, and an SNS application).

FIG. 3 is a detailed block diagram illustrating a mobile terminalaccording to an exemplary embodiment of the present invention.

Referring to FIG. 3, the integrated message management part 1400includes a message monitoring unit 1410, a message information managingunit 1420, a user interface managing unit 1430, and an artificialintelligence agent (AI agent) 1440, each of which may be software,hardware, or a combination of hardware and software configured toperform its respective function.

The message monitoring unit 1410 monitors, in association with the voicecall management part 1100 and the text message management part 1200,updates of information on voice calls and/or text messages received ortransmitted by the mobile terminal 10.

When the mobile terminal 10 receives a voice call, the voice callmanagement part 1100 stores information on the incoming voice call, suchas counterpart (phone number or contact name) information and areceiving time of the incoming voice call, in the memory 1500 of themobile terminal 10. In addition, when the user of the mobile terminal 10has actually answered the incoming voice call, the total conversationtime and/or the call termination time may be recorded in the memory1500. On the other hand, if the user of the mobile terminal 10 does notrespond to the incoming voice call, that is, if a voice call connectionfails, the voice call connection failure may be recorded in the memory1500. As such, the voice call management part 1100 stores theinformation on the incoming voice call in the memory 1500 every time avoice call is received.

The message monitoring unit 1410 accesses the memory 1500 to look upvoice call information stored therein. The message monitoring unit 1410monitors whether the incoming voice call information is updated invarious manners. For example, the message monitoring unit 1410 may beconfigured to periodically access the memory 1500 to monitor whether newincoming voice call information is updated. Alternatively, the messagemonitoring unit 1410 may be configured to monitor updates of incomingvoice call information in real-time. Still alternatively, the messagemonitoring unit 1410 may be configured to access to the memory 1500 tomonitor an update of incoming voice call information only uponactivation of the integrated message management part 1400.

The above-described monitoring update of incoming voice call informationperformed by the message monitoring unit 1410 may also be performed foroutgoing voice call. In particular, the message monitoring unit 1410monitors updates of information on outgoing voice calls originating fromthe user through the mobile terminal 10 in substantially the same manneras described above for the incoming voice call information.

Monitoring of updates of information on text messages, performed by themessage monitoring unit 1410, is described in detail below.

When a text message is received by the user's mobile terminal 10, thetext message management part 1200 stores information on incoming textmessage in the memory 1500 of the mobile terminal 10. The incoming textmessage information may include, for example, a sender, a receivingtime, content of the message, and the like. The message monitoring unit1410 may access the memory 1500 to monitor an update of incoming textmessage information. The message monitoring unit 1410 can monitorwhether the received text message information is updated in variousmanners. For example, the message monitoring unit 1410 may be configuredto periodically access the memory 1500 to monitor whether new incomingtext message information is updated. Alternatively, the messagemonitoring unit 1410 may be configured to detect an update of incomingtext message information in real-time. Still alternatively, the messagemonitoring unit 1410 may be configured to access the memory 1500 tomonitor an update of incoming text message information only uponactivation of the integrated message management part 1400.

The above-described monitoring update of incoming text messageinformation performed by the message monitoring unit 1410 may also beperformed for outgoing text message. In particular, the messagemonitoring unit 1410 monitors updates of information on outgoing textmessages transmitted from the user through the mobile terminal 10 insubstantially the same manner as described above for the incoming textmessage information.

The message information managing unit 1420 is configured to retrieve theupdated voice call information and updated text message informationdetected by the message monitoring unit 1410, and to generate integratedmessage information which will be provided for the user through anintegrated message management user interface 100. For example, when themessage monitoring unit 1410 detects a new incoming voice call, themessage information managing unit 1420 retrieves the incoming voice callinformation, and generates integrated message information based on theretrieved incoming voice call information. The generated integratedmessage information may be stored in the memory 1500.

The above described operation of the integrated message informationmanaging unit 1420 may be performed in synchronization with the messagemonitoring operation of the message monitoring unit 1410.

On the other hand, the message information managing unit 1420 may beconfigured to operate asynchronously with the operation of the messagemonitoring unit 1410. More particularly, regardless of configuration ofmessage monitoring operation, the message information managing unit 1420may be configured to retrieve the update of the voice call informationand the text message information at a different time period than themonitoring period, or may be configured to operate only when integratedmessage information management application is activated.

On the other hand, the message information managing unit 1420 isconfigured to access the memory 1500 to read information about update ofthe message inquired by the message monitoring unit 1410, and togenerate the integrated message information based on the information.

The user interface managing unit 1430 generates and displays anintegrated message management user interface, receives various userinputs through the integrated message management user interface, andperforms processes corresponding to the user input. More specifically,the user interface managing unit 1430, in response to a user input,generates a first message management user interface and displays it on ascreen of the mobile terminal 10. In addition, the user interfacemanaging unit 1430, in response to a user input, may generate a secondmessage management user interface and displays it on a screen of themobile terminal 10. In addition, the user interface managing unit 1430may access the additional function process part 1300 to process anadditional function in association with the first and second messagemanagement user interfaces, and display the processed results on thefirst and second message management user interface.

The integrated message management part 1400 may be hardware, software,or a combination of hardware and software configured to perform theabove-described processes. For example, the integrated messagemanagement part 1400 may be a combination of software includinginstructions necessary to perform the above-described messagemonitoring/message managing user interface managing functions, and aprocessor performing processes corresponding to the instructions. Inthis case, the software which is a part of the integrated messagemanagement part 1400 may be installed in the mobile terminal 10 in theform of an application. The message monitoring unit 1410, the messageinformation managing unit 1420, and the user interface managing unit1430 may be independent software and hardware, respectively. On theother hand, each function of the integrated message management part 1400may be performed in a form of distributed process.

The operation of the integrated message management part 1400 accordingan exemplary embodiment of the present invention will be described inmore detail.

First, the process of generating the first message management userinterface by the user interface managing unit 1430 will be described indetail with reference to FIG. 4 and FIG. 5.

FIG. 4 is a screenshot illustrating an example of a first messagemanagement user interface displayed on a mobile terminal.

Referring to FIG. 4, a first message management user interface 100according to an exemplary embodiment includes a message informationdisplay area 110 and a menu bar 120. The message information displayarea 110 includes a plurality of message blocks 111 and 112. Each of themessage blocks 111 and 112 includes integrated message informationcorresponding to a voice call or a text message. The integrated messageinformation is information generated from voice call information or textmessage information stored in the memory 1500, and may include all orpart of the entries included in the voice call information and the textmessage information.

For example, the message block 111 and 112 display recipient or senderinformation. The recipient or sender information may be provided withreference to the address book. In addition, the message blocks 111 and112 may include an incoming/outgoing indicator indicating whether amessage was received or sent. For example, whether a voice call and atext message are received or transmitted may be indicated by directionof an arrow. The integrated message information may also include amessage type indicator indicating whether the message is a voice call ora text message. Referring to FIG. 4, a message block 111 for a textmessage includes a counterpart 111 a of the text message, a content 111b of a text message, a receiving/sending time 111 c. On the other hand,in the message block 112 for a voice call includes a counterpart 112 a,the receiving/sending time 112 b, the total call time 112 c, andreceiving/sending indicator 112 d.

The user interface managing unit 1430 may sort the message blocks 111and 112 in the order of time. For example, the message blocks 111 and112 may be arranged in descending order according to thereceiving/transmitting time. Accordingly, message blocks 111 and 112 ofthe most recently received or transmitted message are displayed at thetop of the message information display area 110.

FIG. 5 is a flowchart illustrating a process of generating a firstmessage management user interface having the configuration shown of FIG.4.

Referring to FIGS. 4 and 5, in step S1100, the message monitoring unit1410 monitors whether voice call information/text message information isupdated in association with the voice call management part 1100 and textmessage management part 1200.

When the message monitoring unit 1410 detects that voice callinformation or text message information is updated (e.g., new voice calland/or text message is received or transmitted), in step S1200, themessage information managing unit 1420 retrieves the updated voice callinformation and/or text message information. In step S1300, the messageinformation managing unit 1420 edits the call information and/or textmessage information according to a message block format to generate theintegrated message information.

The message block format may define the entries of the messageinformation to be included in the message blocks 111 and 112. Themessage block format may be set by the user or the integrated messagemanagement service server 20. Referring back to FIG. 4, the text messageblock 111 includes a recipient/sender (counterpart) contact 111 a,receiving/transmitting time 111 c, and message body 111 b. In addition,the voice call block 112 includes the recipient/sender (counterpart)contact 112 a, receiving/transmitting time 112 b, total talk time (orcall connection failure indication) 112 c, and receiving/sendingindicator 112 d. The message information managing unit 1420 may extractonly the entries defined by the message block format from the voice callinformation and the text message information, to generate the integratedmessage information.

In step S1500, the user interface managing unit 1430 then generatesmessage blocks 111 and 112, in which the respective entries of theintegrated message information are arranged, according to an arrangementrule defined by the message block format. The arrangement rule definesthe position of each entry of the retrieved integrated messageinformation to be displayed in the message blocks 111 and 112. In theexample of FIG. 4, the counterpart identification information 111 a, themessage body 111 b, and the receiving/transmitting time 111 c may bedefined to be displayed at a specific location of the message blocks 111and 112, respectively. According to the arrangement rule, the userinterface managing unit 1430 generates message blocks 111 and 112, inwhich the each entry of the retrieved integrated message information isarranged, at a position as shown in FIG. 4.

Then, in step S1600, the user interface managing unit 1430 generates afirst message management user interface 100, in which voice callinformation and text message information are arranged, in the order ofreceiving/transmitting time.

The integrated message information generated by the message informationmanaging unit 1420, and/or the message blocks 111 and 112 generated bythe user interface managing unit 1430 may be stored in the memory 1500.Once the integrated message information and/or message blocks 111 and112 are stored in the memory 1500, the user interface managing unit 1430may retrieve the stored integrated message information and/or messageblocks 111 and 112 to generate the first message management userinterface 100 without repeating the above processes. In this case, for anew voice call and/or text message, the above-described processes may beperformed to display the newly generate the message blocks 111 and 112in the first message management user interface 100.

In the above examples, the message information managing unit 1420 editsof voice call information and text message information to generate andedit the integrated message information. However, the above processesmay be performed by the user interface managing unit 1430 partially orentirely. For example, when a message block format defines that an entryrelated to the receiving/sending indicator is to be displayed using anarrow image, in step S1600, the user interface managing unit 1430 mayreplace the receiving/sending indicator with the arrow image whengenerating the first message management user interface 100.

The first message management user interface 100 of FIG. 4 includes amenu bar 120. The first message management user interface mode selectionicons 121 a, 121 b and 121 c, a search tool 122, and an address bookicon 123 are displayed on the menu bar 120.

When the input window of the search tool 122 is touched, the userinterface managing unit 1430 provides a character input user interface.When the user inputs a search word through the character input userinterface, the user interface managing unit 1430 looks for theintegrated message information including the input search word through asearch engine built in the integrated message management part 1400, anddisplays the search result on the first message management userinterface 100.

When the user touches the address book icon 123 of the menu bar 120, theuser interface managing unit 1430 accesses the address book applicationand retrieves the contact information. At the same time, the userinterface managing unit 1430 converts the first message management userinterface 100 into an address book user interface, and displays it on ascreen of the mobile terminal 10.

Upon receiving a user inputs selecting a message block of FIGS. 4 and 5,e.g., touching a message block 111, 112, details of the selected messageblock may be displayed on the terminal 10. The user interface managingunit 1430 may be configured to provide a second message management userinterface, which displays details of a message in response to the userinput of selecting the message blocks 111 and 112 of the first messagemanagement user interface 100.

Hereinafter, the process of generating the second message managementuser interface will be described in detail with reference to FIG. 6 andFIG. 7.

FIG. 6 is a flowchart illustrating a process of creating a secondmessage management user interface, and FIG. 7 is a screenshotillustrating an example of a second message management user interfaceprovided by the integrated message management part 1400.

In step S2100, the user interface managing unit 1430 receives a userinput activating a second message management user interface. The userinput activating a second message management user interface may be, forexample, the user touching the message blocks 111 and 112 of the firstmessage management user interface 100, as described above. In addition,the user input activating the second message management user interfacemay be the user touching the message notification displayed on thestatus bar of the mobile terminal 10 when the integrated messageinformation management application is not activated.

In step S2200, when a user input activating the second messagemanagement user interface is received, the user interface managing unit1430 identifies the counterpart (recipient/sender) of the selectedmessage block. In step S2300, the message information managing unit 1420retrieves all of the voice call information and the text messageinformation of which recipient/sender is the identified counterpart. Instep S2400, the message information managing unit 1420 edits the voicecall information and the text message information to generate a dialogueinformation according to a predetermined dialogue information format.The dialogue information format defines entries to be displayed and anotation of each entry. For example, the dialogue information format fora voice call may be defined as displaying receiving/sending time in aform of “HH:MM AM (or PM)” and total conversation time in a form of“HH:MM:SS”. On the other hand, the dialogue format for the text messagemay be defined as displaying receiving/sending time in a form of “HH:MMAM (or PM)” and message body in a form of full-text of the message. Themessage information managing unit 1420 extracts only the entries definedby the dialogue information format from the voice call information andthe text message information, and edits the extracted entries in theform defined by the dialogue information format to generate the dialogueinformation.

In the above described example, the step S2400 of generating dialogueinformation is described as being performed by the message informationmanaging unit 1420. However, according to an exemplary embodiment, allor a part of the process in step S2400 may be performed by the userinterface managing unit 1430.

Next, in step S2500, the user interface managing unit 1430 visualizesthe dialogue information according to the dialogue configuration rule,and in step S2600, generates a second message management user interfaceincluding the dialogue information. The dialogue configuration ruledefines the arrangement and display form of each entry of the dialogueinformation. For example, the dialogue information rule may define: 1)dialogue information of the incoming voice call and the text message isplaced on the left side of the interface and dialogue information of theoutgoing voice call and the text message is placed on the right side ofthe second message management user interface 500; 2) total conversationtime of a voice call and full text of a message is provided in a form ofa speech bubble; 3) the receiving/sending time is displayed outside thespeech bubble; and 4) all the dialogue information is listed indescending order according to the receiving/sending time. The userinterface managing unit 1430 processes and visualizes each entry ofdialogue information according to the dialogue configuration rule, andgenerates a second message management user interface displaying thevisualized results.

The second message management user interface generated according to theabove exemplary dialog information format and dialog configuration ruleis as shown in FIG. 7.

Referring to FIG. 7, the second message management user interface 500includes a dialogue title region 510, a dialogue display region 520, anda character input region 530. In the title region 510, counterpartinformation and a telephone dialing icon is provided. In the dialoguedisplay region 520, the dialogue information is displayed. For example,the unit dialogue 521 corresponds to an outgoing voice call. Inaccordance with the dialogue information format and the dialogueconfiguration rule, the total call time entry is inserted into a speechbubble in the form of “voice call 03:07” and sending time entry isdisplayed at left side of the speech bubble in a form of text string“11:03 AM”. The unit dialogue 522 relates to a received text message. Inaccordance with the dialogue information format and the dialogueconfiguration rule, the received text is inserted into a speech bubblein the form of full text “OK!”, and receiving time is displayed at rightside of the speech bubble in a form of text string “08:02 PM”. Inaddition, the unit dialogue 522 related to the received text message isarranged on the left side of the interface, the unit dialogue 521related to the outgoing voice dialogue is arranged on the right side ofthe interface, and the dialogues are arranged in order ofreceiving/transmitting time.

The second message management user interface 500 is configured toprovide detailed information on messages exchanged with a specificperson (counterpart). For example, the second message management userinterface 500 may be configured to provide information on voice callsand text messages exchanged with a specific user in an interactivemanner. While the first message management user interface 100 listsinformation on all message in a time series, the second messagemanagement user interface 500 displays more detailed contents ofmessages exchanged with a specific entity.

The second message management user interface 500 may be provided inresponse to various user inputs. First, as described above, when theuser interface managing unit 1430 detects a user input, such as touchinga specific message block displayed on the first message management userinterface 100 (“message block selection input”), the user interfacemanaging unit 1430 identifies the counterpart (recipient or sender) ofthe selected message block. The user interface managing unit 1430accesses the memory 1500 to retrieve integrated message information onvoice calls/text messages received from and transmitted to thecorresponding counterpart, generates the second message management userinterface 500 by listing the retrieved integrated message information ina time series, and displays it on the mobile terminal 10. As such, inresponse to the user's message block selection input, the user interfacemanaging unit 1430 switches the first message management user interface100 to the second message management user interface 500.

The second message management user interface 500 may display and provideeach message information in an interactive format. For example,referring to FIG. 7, the information on a received message is displayedon the left side, and the information on a transmitted message isdisplayed on the right side. The incoming speech bubble 522 and theoutgoing speech bubble 521 may have different colors or fonts for easyidentification.

The second message management user interface 500 may be configured toinclude a character input region 530. The character input region 530 maybe disposed at the lower end of the second message management userinterface 500, as shown in second message management user interface 200of FIG. 17. The character input region 530 includes a character inputwindow 531 and a “send” graphical user interface 532.

The artificial intelligence agent 1440 analyzes the contents of theincoming and outgoing text messages, and provides one or more servicescorresponding to the analyzed message contents to the user.

Hereinafter, the configuration and operation of the AI agent 1440 willbe described in detail with reference to FIG. 8.

FIG. 8 is a block diagram illustrating the configuration of anartificial intelligence agent 1440 according to an embodiment of thepresent invention.

The artificial intelligence agent 1440 is configured to include a speechact analysis module 1441, a dialog tracking module 1442, and a serviceresponse generation module 1443, each of which may be software,hardware, or a combination of hardware and software configured toperform its respective function.

The speech act analysis module 1441 performs morpheme analysis andspeech act analysis on the messages of the user and the conversationpartner. The morpheme analysis is a process of separating the text ofthe message into morpheme units, that is, dictionary headwords,restoring the original form of the deformed morpheme, and obtainingconsecutive morphemes matching a word formation rules from the separatedunit morphemes. Speech act analysis is performed for each unit ofspeech, and it is a process of deducing the purpose of a message fromthe format of the unit of speech. A speech unit may be a corpus whichmay end with a sentence final ending and ending signs such as a period,a question mark, an exclamation mark, and the like. The unit of speechis analyzed to a primary speech act which is the speaker's purpose ofthe communication, an intended subject which is a subject intended toconvey to an audience through the message, and the related element whichis a specific entity related to the intended subject. Each speech unitmay be analyzed by the speech act analysis module 1441 and tagged in theform of a ‘[primary speech act]_[intended subject]_[related element]’.For example, the speech act analysis process for a sentence “When willbe the next meeting?” will be described as follows. First, this sentenceis divided into plural morphemes by morpheme analysis, and the meaningof each morpheme is grasped. Next, the speech act analysis is performedfor analyzing the format and intent of this message. Since the messagebegins with an interrogative adverbial “when” and ends with the questionmark “?”, the purpose of this sentence (primary speech act) is ‘questionon time’ (i.e. request for information on time). In addition, throughthis message, the subject intended by the speaker, that is, the intendedsubject is a ‘decision of meeting date’, and the related element whichis a concrete object related to the meaning action is ‘next meeting’. Asanother example, the process of the speech act analysis of the message“6 o'clock is not available because the reservation is full” is asfollows. Through morpheme analysis and analysis of sentences, thepurpose of the sentence may be analyzed as ‘delivery of information’since this sentence is terminated by a period and contains specificinformation. The subject of the speaker intended to deliver through thesentence, that is, the intended subject is ‘rejection’, and the relatedelement (object of rejection) related to the rejection is ‘6 o'clockreservation’. The speech act analysis module 1441 of the presentinvention grasps the purpose, the intention of the speaker, and therelated elements of a message as a speech act unit through the speechact analysis.

The dialog tracking module 1442 performs a function of continuouslytracking messages included in a conversation between two or morespeakers. The dialog tracking function trace of morpheme/speech actanalysis on an each message based on the context of conversation betweentwo or more speakers. For example, the dialog tracking module 1442 maybe configured to trace the results of speech act analysis of eachmessage included in the conversation list displayed on the secondmessage management user interface according to one embodiment of thepresent invention.

The service response generation module 1443 generates responsescorresponding to the intent and purpose analyzed by the speech actanalysis module 1441 and/or the dialog tracking module 1442 and providesthe responses for the user. A response generated by the service responsegeneration module 1443 of the AI agent 1440 may be provided inassociation with the additional function process part 1300.

FIG. 9 is a flowchart illustrating a service processing procedure of theAI agent 1440 according to an embodiment of the present invention.

First, the message monitoring unit 1410 monitors reception andtransmission of a text message from the text message management part1200 (S3100). The artificial intelligence agent 1440 performs morphemeanalysis and speech act analysis on the received or transmitted textmessage (S3200), and analyzes the intent of the message using the resultof the morpheme analysis and the speech act analysis (S3300).Morpheme/speech act analysis and message intention analysis is performedby the speech act analysis module 1441 and dialog tracking module 1442of the artificial intelligence agent 1440. Then, the service responsegeneration module 1443 of the AI agent 1440 searches for a servicecorresponding to the analyzed message intention (S3400), generates aservice response corresponding to the analyzed message intention, andprovides the service response for the user terminal S3500).

Hereinafter, the operation of the AI agent 1440 will be described indetail with an example of a service.

<Generation of Schedule Information>

According to an embodiment of the present invention, the AI 1440 may beconfigured to provide a service for analyzing text included in theconversation list to generate schedule information.

First, the speech act analysis module 1441 of the artificialintelligence agent 1440 performs morpheme analysis and speech actanalysis on a new incoming/outgoing text message, and determines whetherthere is a morpheme related to a schedule in the result of the analysis.A schedule is a list of something to be done at a specific time orperiod, so it is related to time. Therefore, it is possible to determinethe relevance to a schedule by determining whether there is atime-related morpheme in the receiving or originating message.Identification of the morpheme associated with a schedule can beperformed in various ways. For example, the speech act analysis module1441 may be configured to identify morpheme having a specific formatindicating a date and time. For more specific example, the artificialintelligence agent 1440 may be configured to identify a format ofYYYY/MM/DD, YYYY.MM.DD, MM/DD or, MM.DD, YYYY, Monday, today, tomorrow,hh:mm am(pm) and the like, which indicates a specific time. In addition,since an interrogative sentence may be used for arranging time beforethe schedule has not be confirmed yet, the AI 1440 maybe configured toidentify morphemes such as “when”, “which day” and the question mark “?”as morphemes related to a schedule.

If it is determined by the morpheme analysis that the message includesthe morphemes related to a schedule, the speech act analysis module 1441of the artificial intelligence agent 1440 performs the analysis of thespeech to grasp the intent and the contents of the message. In otherwords, the speech act analysis module 1441 performs an analysis of asingle incoming/outgoing message to identify specific informationrelated to a schedule included in the message, that is, information suchas planned work, place, related persons, and so on.

In general, a schedule includes a specific time and a task (action)scheduled at the specific time, as necessary items. In order to performthe process of generating schedule information according to the presentinvention, either time or task needs to be specified. For a message ofwhich a task has been specified but time has not been yet specified, orfor a message of which time has been specified but a task has not beenspecified, subsequent processing for generating schedule information isperformed. However, for messages that do not have two items, Nosubsequent processing for generating schedule information is performed.A typical example of a schedule-related message that does not specifytime is a suggestion such as “Let's go to a movie.” A typical example ofa schedule-related message that does not specify a task is “What are youdoing today?”. Additional information that constitutes the schedule mayinclude the space (place) where the task is performed, the other party(or collaborator) related to the task, the end time (period) of thework, and other information.

The AI 1440 according to an exemplary embodiment of the presentinvention analyzes the message and generates schedule information havingthe following data entries.

Schedule information: [time]_[task]_[place]_[related person]_[end timeof work]_[additional information]

For such morpheme analysis and speech act analysis of the artificialintelligence agent 1440, rules for each analysis are required. Analysisrules are generated based on the dialogue model. A dialog model is datamodeling conversations, i.e., messages exchanged between two or morespeakers. The server may be configured to collect user's conversationdata for establishing a dialog model. The server may use the messageexchange through the message integration management platform accordingto the present invention as well as use the dialog data outside theplatform to construct the dialog model.

The dialogue model is largely classified into a rule-based model and astatistical-based model. Representative rule-based models include aplan-based dialogue model and an active ontology-based dialogue model. Aplan-based dialogue model is a way of designing a dialogue model bydividing a work into a domain, problem solving, and detailed plan ofdiscourse so that the work can be easily and flexibly adjusted accordingto the agenda. An active ontology-based dialogue model divides work intoconcepts in ontology and generates a system response structure necessaryfor service through inference. Representative statistical based modelsinclude an example-based dialogue model and a Partially ObservableMarkov Decision Process (POMDP). The example-based dialog model isconfigured to generate a dialogue example index using the languageanalysis engines for the dialogue example big data object, and to searchthe dialogue example index to find the most similar example to theuser's speech act. POMDP is a reinforcement learning model thatprobabilistically models user behavior by learning from pastconversation histories.

The server generates analysis rules and response rules based on thedialog model.

The analysis rules and response rules generated by the server aredownloaded and installed in the user terminal. The server may update thedialog model and analysis rules 1444 and response rules based on thecollected data. In this case, the server may transmit the updatedanalysis rule 1444 and the response rule to the user terminal, so thatthe artificial intelligence agent 1440 installed in the user terminalperforms the operation with reference to the updated analysis rule 1444and the response rule.

The artificial intelligence agent 1440 according to the presentinvention is configured to analyze incoming and outgoing messagesaccording to analysis rules 1444 generated based on one of the abovedialog model and to provide a service, as a response, corresponding tothe analysis results. That is, the artificial intelligence agent 1440may provide various services through the service response generationmodule 1443.

It is possible to classify the schedule related messages by type andfollow the process of determining the schedule in the conversationbetween two or more speakers according to the message type. According toan embodiment of the present invention, the artificial intelligenceagent 1440 is configured to determine the type of dialogue throughspeech act analysis and to perform the message analysis routineaccording to the identified message type of the dialogue to generate theschedule information.

According to one embodiment of the present invention, the type ofconversation for arranging a schedule may be determined according to thefirst message that triggers the conversation related to the schedule,which may be classified as follows.

Type 1 (notification type): A message that unilaterally specifies timeand task, which is the minimum item necessary for scheduleestablishment. A schedule specified in the message is establishedregardless of the recipient's intention.

Type 2 (complete proposal type): A message that proposes to the otherparty a time and task, which are the minimum items necessary forscheduling A consent of the recipient of the message is required. Thefirst proposed schedule may be replaced by another schedule(alternative) in process of conversation between the two speakers. Inorder to fix an alternative as a schedule, the consent of the recipientof the message containing the alternative is required. Therefore, forthe initial proposal of Type 2, the follow-up messages should beanalyzed to determine whether the other party's consent, whether or notan alternative is presented, and whether there is consent to thealternative. “Are you ok with Next meeting on February 18?” would be anexample of this type.

Type 3 (incomplete proposal type): A message containing a proposal thatdoes not specify either time or task. In case of belonging to this type,it is necessary to specify the non-specified item that in order togenerate schedule information. Therefore, for the initial proposal oftype 3, the follow-up message should be analyzed to determine whetherthe unspecified item of the initial proposal has been specified. If theinitial proposal is specified through the follow-up messages, thespecified proposal has the same properties as the type 2. “Let's playgolf” and “When will the next general meeting be?” is an example of theType 3 message.

The above message classification is an exemplary classification, but themessages may be classified in a different way based on the collectedconversation data and the dialog model.

First, a process of determine a schedule for a first type message, i.e.,a notification type message will be described as follows.

When one party notifies that a specific action is scheduled at aspecific time, the notified time and action are fixed to a schedule. Themessage to notify the schedule is usually in the form of a declarativeor imperative sentence. However, messages delivering scheduleinformation in the form of statements and statements are not necessarilynotice of a fixed schedule. The speech act analysis module 1441 of theartificial intelligence agent 1440 according to an embodiment of thepresent invention may be configured to refer to the sender informationof the message to determine whether the received message is a messagefor notice of a fixed schedule. Generally, a fixed schedule notificationis often received from a specific opponent. For example, a notice ofvarious due dates delivered by a government office, a notice of maturityand payment due delivered by a financial institution, a reservationconfirmation delivered by a travel agency or an airline, and a notice ofa scheduled shipping time delivered by a shipping company arenotifications related to a fixed schedule. Thus, the speech act analysismodule 1441 of the AI 1440 may be configured to analyze the senderinformation included in the message to determine whether the message isrelated to a fixed schedule. In general, a schedule includes a task andat a specific time as essential items. Other additional informationconstituting the schedule may include a space (place) where the task isperformed, a partner (or collaborator) related to the task, atermination time (period) of the task, and other information.

Type 2 and Type 3 have different schedule generation paths than Type 1.That is, when the messages of type 2 and type 3 are transmitted to theother party in the form of a proposal or a question of one of aplurality of speakers, a conversation for establishing a schedule isstarted by this message. Hereinafter, the first proposal or questionrelating to a schedule will be referred to as an ‘initial proposal’, andthe speaker presenting the initial proposal will be referred to as a‘first speaker’ and the other party referred to as a ‘second speaker’.Also, a set of messages exchanged between two speakers is called‘conversation’, and a message generated after one message is called‘subsequent message’. Further, a pair of consecutive messages betweentwo speakers is called a ‘neighbor message pair’. For example, a messageof a first speaker and a message of subsequent response of the secondspeaker form a neighbor message pair. In general, the neighbor messagepair may be two adjacent messages displayed on the second messagemanagement user interface, but in some cases, a plurality of messagesmay form a neighboring message pair. For example, when a second speakerresponds to a plurality of consecutive messages of the first speakerwith one message, the entire (logical AND) of the plurality of messagesof the first speaker and the messages of the second speaker form aneighbor message pair.

Messages belonging to type 2 or type 3 have the form of a suggestion orquestion. The suggesting sentence is typically terminated by a sentencestarting with a syntactic unit “Let's ˜”, “Why don't ˜” “Would ˜”, andthe like. A question typically start with an interrogative andterminates with a question mark “?”. Questions may be classified intopolar questions (yes-no questions) to which answer is yes or no, andnon-polar questions (wh-questions) which requires a specific answeraccompanied by an interrogatory.

Although time and task are specified in the type 2 message, the schedulecontained in the message is confirmed only when the consent of thesecond speaker is received. Thus, the AI 1440 tracks subsequent messagesto determine whether the second speaker agrees with the scheduleproposed by the first speaker. If there is consent of the secondspeaker, the schedule proposed by the first speaker is confirmed. Ifthere is no consent of the second speaker, the artificial intelligenceagent 1440 determines whether there is a counter offer for the initialoffer of the initial message. The alternative (counter offer) may alsobe presented by the first speaker or the second speaker. Since thisalternative proposal also requires the consent of the other party whoproposed the alternative, the AI 1440 tracks and analyzes the follow-upmessages to confirm whether the other party agrees to the alternativepresentation. The presentation of the alternative may be repeatedseveral times between the first speaker and the second speaker.

According to ordinary message exchange cases, consent or rejection of aproposal may not follow it immediately. For example, a person who hasbeen offered a schedule may ask after the proposer before approval orrejection. In addition, after a negative reply, the conversation forrearrangement of a schedule may be continued by the presentation of thefirst proposer's or the other party's alternative. Therefore, when aresponse to the proposal of a schedule does not include an agreement,the schedule information generation function does not work correctly ifthe determination of agreement is performed for only a single messageconsecutive to the proposal. Therefore, it is desirable to keep track ofthe messages exchanged after the initial proposal for a considerableperiod of time to determine whether the consent or alternatives arepresented. However, infinitely continuing message tracking for detectionof alternatives and consent for the initial offer may increase theprocessing load of the mobile terminal and exceed the capabilities ofthe AI 1440, the number of performing the message tracking may besuitably limited by the analysis rule 1444. For example, the analysisrule 1444 may regulate that the second speaker's consent and alternativepresentation are to be tracked only for N subsequent messages (where Nis a natural number) from the initial proposal. That is, the AI 1440stops message tracking and the schedule information generation processif no consent of the second speaker or presentation of an alternativewithin the n subsequent messages from the initial proposal. If a consentmessage of the second speaker is detected within the subsequent messagefrom the initial proposal, the artificial intelligence agent 1440confirms the schedule information. Also, if there is an alternativepresentation by the first speaker or the second speaker, the messagetracking is continued from the presentation of the alternative, even ifthere is no agreement of the second speaker within the subsequentmessage. In this case, the same restriction as the initial proposal isapplied to the presentation of alternatives, that is, the AI agentmonitors whether a consent or other alternatives are presented within Nsubsequent messages after the presentation of the alternative. N isdetermined on the basis of a dialogue model. In a typical conversation,a consent on a schedule or presentation of an alternative is made within1-5 consecutive messages, so N may be determined about 5.

A message of type 3 cannot confirm the schedule even with the consent ofthe other party. This is because the initial proposal of this type is asimple proposal that does not specify a date and time. In order forspecific schedule information to be generated by the initial proposal oftype 3, the time must be specified by the first speaker and the secondspeaker. Thus, if a suggestion of type 3 is presented, the AI 1440tracks the subsequent messages to determine if the schedule ismaterialized. The materialization of the schedule is made by proposal ofa specific time and agreement to the proposal of the time between thefirst speaker and the second speaker. In other words, the AI 1440 tracksand analyzes the messages following the initial proposal and determineswhether the first speaker or the second speaker suggests a specific dateand time. The process of tracking and analyzing the proposal and theconsent of the other party is carried out in the same manner as trackingand analyzing the first proposal (or alternative) and agreement for thetype 2 message.

The artificial intelligence agent 1440 may generate and use scheduleinformation even when the dialog including the type 2 and type 3messages is tracked and analyzed. For example, according to anembodiment of the present invention, the AI 1440 may be configured togenerate and temporarily store schedule information for an initialproposal, and to update the temporarily stored schedule informationwhenever an alternative is presented. The updated schedule informationis temporarily stored in the memory 1500 of the user terminal until theother party agrees. At this time, temporary storage of the scheduleinformation is maintained only within the message tracking limitdescribed above. For example, if no consent or alternative is presentedwithin the N subsequent messages from the initial proposal, thetemporarily stored schedule information is deleted in memory 1500 andthe tracking is stopped.

FIG. 10 is a flowchart illustrating a process of generating scheduleinformation of the AI agent 1440 according to an embodiment of thepresent invention.

The artificial intelligence agent 1440 receives the text messagereceived from the mobile terminal or transmitted through the mobileterminal (S5110). The incoming and outgoing text messages may betransmitted to the artificial intelligence agent through the textmessage management part 1200 or the message monitoring unit 1410 of theintegrated message management part 1400.

The speech act analysis module 1441 of the artificial intelligence agent1440 performs morpheme analysis and speech act analysis on the receivedor transmitted text message (S5120), and determines whether the messageincludes necessary items for generating schedule information (S5130).Whether or not the necessary items for generating the scheduleinformation are included is judged based on presence of a morphemehaving a temporal meaning (time related morpheme), of the relationshipbetween the morpheme representing time (time related morpheme) andpresence or absence of a morpheme representing an action or a state(task related morpheme), and a relationship between the two morphemes.Specifically, the speech act analysis module 1441 of the artificialintelligence agent 1440 divides the texts of the received or outgoingtext messages by morphemes (morpheme analysis), analyzes the meaning ofeach morphemes, the relationship between the morphemes, and thestructure of the sentences to interpret the intent of the message(speech act analysis). That is, the artificial intelligence agent 1440judges whether a time-related morpheme and a work-related morphemepresent in the message through the morpheme analysis and the speech actanalysis as mentioned above, and determines whether the intent of themessage is to establish a schedule.

If it is determined that the message contains a necessary item forgenerating schedule information, the service response generation module1443 generates schedule information (S5140). The generated scheduleinformation is temporarily stored in the memory 1500.

If it is determined that the message includes none of the necessaryitems, the service response generation module 1443 ends (END) theprocess for generating schedule information.

Following the morpheme/speech act analysis of the message by the speechact analysis module 1441, the artificial intelligence agent 1440determines whether the message belongs to a type 1, i.e., a notificationtype message for notifying a specific task at a particular time (S5150).

If the message is determined to be a type 1 message, the artificialintelligence agent 1440 executes the schedule management application andregisters the generated schedule information (S5160).

The schedule information registration process may be performed invarious ways. According to an embodiment of the present invention, theservice response generation module 1443 may be configured toautomatically execute the schedule management application without theuser's intervention, write the generated schedule information into theschedule management application, and register the schedule information.At this time, the service response generation module 1443 may beconfigured to store a message related to schedule information or entireconversation in association with the generated schedule information. Forexample, the service response generation module 1443 may be configuredto insert, into the schedule information, a link to access a finalagreement message or the conversation containing the message. The usercan view the schedule information through the schedule managementapplication. At this time, the user may execute the link to check themessage or conversation related to the schedule.

According to another embodiment of the present invention, the serviceresponse generation module 1443 can be configured to check whether theuser approves the registration of the generated schedule information.For example, the service response generation module 1443 transmits thegenerated schedule information to the user interface managing unit 1430,and requests the generation of the schedule information registrationgraphical user interface thorough which a user can confirm theapproval/rejection of the user for the schedule information. At thistime, the service response generation module 1443 may be configured tohave a speech generation function of constructing the generated scheduleinformation as a sentence and providing it to the user. When theapproval input of the user is received through the schedule informationregistration graphical user interface, the service response generationmodule 1443 executes schedule management application and registers thegenerated schedule information.

If it is determined that the incoming/outgoing message is not a type 1of notification message, the AI agent determines that the message is aType 2 of complete proposal message (S5210). If it is determined whichthe incoming/outgoing message corresponds to a type 2 message, the AIagent 1440 tracks and analyzes the subsequent message. At this time, asdescribed above, the message counter is initialized to limit theexecution length of the trace analysis routine for the subsequentmessages to N messages (N is a natural number). Therefore, the value iof the message counter is set to the initial value 1 (S5220).

The artificial intelligence agent 1440 performs the morpheme analysisand the speech act analysis on the adjacent subsequent message (i=1)(S5230). That is, the speech act analysis module 1441 of the artificialintelligence agent 1440 performs morpheme analysis and speech actanalysis on the message immediately following the initial proposal.

The artificial intelligence agent 1440 determines whether theneighboring subsequent message (i=1) agrees with the initial proposalusing the morpheme/speech act analysis result (S5240). If it isdetermined that the neighboring response message (i=1) is consent to theschedule proposed by the first speaker, the service response generationmodule 1443 performs a process for registering the schedule information(S5160). The processing for the schedule information registration isperformed in the same manner as the case of the type 1 message describedabove.

If it is determined that the response message is not a consent to theproposed schedule, the AI 1440 determines whether an alternative ispresented in this message (i=1) (S5250), through the morpheme/phoneticanalysis for the subsequent message (i=1). Since the presentation of thealternative is another proposal, it may be determined whether themessage (i=1) is an alternative presentation by the same method as themorpheme/speech act analysis method for the initial proposal.

If it is determined that the message (i=1) is an alternativepresentation, the artificial intelligence agent 1440 updates theschedule information using the items included in the alternative andtemporarily stores the updated schedule information in the memory 1500(S5260).

Since the alternative is a new proposal, the confirmation of theschedule requires the other's agreement on the alternative. Therefore,the AI 1440 should track and analyze the message following thealternative message (i=1). At this time, it is preferable to apply thesame restriction of the tracking routine for the initial proposal to thealternative consent tracking routine, so the message counter isinitialized (S5230). That is, by the alternative presentation message,the message counter value is initialized to i=1, and the number ofperformance of tracking messages subsequent to the alternative messageis limited to N.

If the message (i=1) does not correspond to the alternativepresentation, the AI 1440 increments the message counter by 1 (S5270) toanalyze the next message, and if the increased message counter valueexceeds the maximum allowed routine repeat It is determined whether thenumber N is exceeded (S5280). If the increased message counter valuedoes not exceed N, the AI agent 1440 repeats the above-described routineof S5230 to S5280 for the subsequent message (i=2). The execution of theroutine of S5230 to S5280 is stopped when the message counter valueexceeds the maximum number of routine repetitions N, and the AI agent1440 ends the constant information generation processing.

If the message does not correspond to type 2, the artificialintelligence agent 1440 determines whether the message corresponds totype 3 using the morpheme/speech act analysis result of the message(S5310).

If it is determined that the message does not correspond to type 3, theAI 1440 ends the process of generating the predetermined information.

The type 3 message needs to specify the essential items by thesubsequent messages for schedule confirmation. Accordingly, if it isdetermined that the incoming/outgoing message corresponds to the type 3message, the AI agent 1440 tracks and analyzes the subsequent message.In this case, as described above, the AI agent 1440 operates the messagecounter to limit the execution length of the trace analysis routine ofthe subsequent message to M messages (M is a natural number). At thistime, the value j of the message counter is set to the initial value 1(S5320).

The artificial intelligence agent 1440 performs morpheme analysis andspeech act analysis on the adjacent message (j=1). That is, theartificial intelligence agent 1440 performs morpheme analysis and speechact analysis on the message immediately following the initial proposal(S5330).

Then, the artificial intelligence agent 1440 determines whether theadjacent subsequent message (j=1) is a message specifying the scheduleproposed by the first speaker, using the morpheme analysis and speechact analysis results (S5340).

If it is determined that the neighbor subsequent message (j=1) is amessage specifying the first proposal, the AI 1440 updates the scheduleinformation using the items included in the neighbor subsequent message(S5350). A message materializing the incomplete proposal belongs to type1 or type 2. Therefore, the artificial intelligent agent determineswhether the neighbor subsequent message (j=1) belongs to type 1 usingthe morpheme/speech act analysis result of the adjacent subsequentmessage (j=1) (S5150), and registering the schedule information if theneighbor subsequent message is type 1 message (S5160). If the neighborsubsequent message (j=1) does not belong to type 1, it belongs to type2, and thus the AI agent 1440 performs the processes of S5220 to S5280described above.

If it is determined that the neighbor subsequent message (j=1) is not amessage specifying the first proposal, the AI 1440 increments themessage counter value by 1 (S5360), and if the increased message countervalue is the maximum number of routine repetitions M is exceeded(S5370). If the increased message counter value exceeds M, the AI 1440stops the message tracking and the schedule generation process. If theincreased message counter value does not exceed M, the process of S5330to S5370 is repeated for the next message.

Hereinafter, a type 1 message analysis and schedule informationgeneration operation according to an exemplary embodiment of the presentinvention will be described in detail with reference to the followingreceived text message.

<Exemplary Received Text Message>

“From Seoul City,

The deadline for the local tax payment of Hong Gil-dong is Mar. 30,2017. For more information, please visit www.tax.seolul.go”.

First, the speech act analysis module 1441 divides the text included inthe received text message into morphemes, which are the smallest unitshaving meaning, and analyzes the usage of each morpheme. This receivedtext message may be morpheme-analyzed as follows.

<Morpheme Analysis Result>

The (definite article)−deadline (noun)−for (preposition)−local tax(noun+noun)−payment (noun)/of (preposition)−Hong Gil-dong (propername)−is (verb)−Mar. 30, 2017 (proper noun+numeral+numeral, date).

The artificial intelligence agent 1440 recognizes that the morphemecontinuum “Mar. 30, 2017” indicating the specific time is included inthe received text message through the speech act analysis module 1441.Then, the speech act analysis module 1441 analyzes the relationship ofeach morpheme, that is, the structure of the sentence, to determine whatthe date is related to. The speech act analysis module 1441 determinesthat the message is a declarative sentence based on the relationshipbetween the date and the verb “is”, and that the purpose of the message(primary speech act) is the delivery (i.e., notification) of theinformation on date. Subsequently, the speech act analysis module 1441recognizes that the subject of this sentence is deadline of local taxpayment based on connection between “deadline of local tax payment” and“is”. Therefore, the speech act analysis module 1441 interprets “Mar.30, 2017” and “deadline of local tax payment” is time and task,respectively for a schedule, and then generates schedule information asfollows. In addition, ‘Seoul City’, a sender of the message, is added tothe related item, and the hyperlink providing the related information isadded to the additional information item, respectively.

<Schedule Information Data>

[2017.3.30]_[deadline of local tax payment]_[N/A]_[SeoulCity]_[www.tax.seolul.go]

According to the analysis, since this message corresponds to the type 1for a certain notification purpose, the service response generationmodule 1443 performs a process of registering the generated scheduleinformation.

The schedule information registration process is performed through theabove-described process.

As described above, when the schedule cannot be determined by themorpheme analysis and the speech act analysis, that is, for the type 2or type 3 message, the context of the conversation should be analyzed bythe dialog analysis module in order to generate the scheduleinformation.

Hereinafter, an operation of message analysis and schedule informationgeneration for the type 3 messages according to an embodiment of thepresent invention will be described in detail with reference to FIG. 11.

FIG. 11 is a screen shot showing a second message management userinterface 200 displaying a dialog between the user of the mobileterminal and a friend of the user.

First, the artificial intelligence agent 1440 performs morpheme analysison the received message A1 through the speech act analysis module 1441,and detects a morpheme when the message A1 refers to an unspecifiedtime. Next, the speech act analysis module performs speech act analysisfor the message A1. The speech act analysis module recognizes that themessage A1 suggests playing “golf” without specifying the time, based onthe entire sentence structure and the connection or relationship betweeneach morpheme. More specifically, since the morphemes “would you”contained in the message A1 is a typical sentence start indicating anask or suggestion, the speech act analysis module determines the purposeof the message, that is, the primary speech act is a suggestion, andthat object of the suggestion is playing golf together. The ‘playinggolf together’ which is the object of the suggestion, but the message A1does not specify time. Accordingly, the AI agent 1440 recognizes thatthe message A1 is a message corresponding to type 3, and that the userintends to propose golf without specifying the time. Therefore, the AIagent tracks and analyzes the message following the message A1. At thistime, the artificial intelligence agent 1440 initializes the messagecounter and counts the message. That is, the artificial intelligenceagent 1440 performs morpheme analysis and transcriptional analysis onthe message B1 (j=1) following the message A1. Meanwhile, the artificialintelligence agent 1440 generates schedule information and temporarilystores the generated schedule information in the memory 1500 of the userterminal. The data structure of the generated schedule information is asfollows.

[N/A]_[Golf]_[N/A]_[Friends 1]_[N/A]_[N/A]

Message B1 contains two phrase, “sounds good” and “how about next week”.The speech act analysis module 1441 performs morpheme analysis on twosentences, and performs speech act analysis based on sentence structureand relationship between the analyzed morphemes. The speech act analysismodule regards the message B1 as an agreement to Friend 1's proposalfrom the first sentence, “sounds good” In addition, the speech actanalysis determines that the message B1 has a purpose of materializingthe initial proposal of Friend 1, which does not specify ‘when’, basedon the contextual connection between the morphemes “how about” and “nextweek”. However, the morphemes “next week” contained in message B1 is notperfect to specify the starting time of the planned task ‘golf’. Thus,the AI agent 1440 increments the message counter value by one and thencompares this value with 5, which is the maximum allowable number ofrepeating the routine. Since the increased message counter value is 2,it is smaller than the maximum allowable number 5, so that dialogtracking and the message analysis are continued for the next message(j=2). Meanwhile, since the starting point of the planned task ‘golf’may not be specified, the schedule information generated and temporarilystored by the initial proposal is not updated.

Artificial intelligence agent 1440 performs morpheme analysis and speechact analysis on the following message A2. The message A2 contains amorpheme “OK” expressing positive intent, a preposition “except” meaningexclusion, nouns “Wed” and “Tue”, which specifies a day of the ‘nextweek’. The speech act analysis module of the artificial intelligenceagent 1440 recognizes, from the meaning of these morphemes and theirconnection, that message A2 is intended to convey partial agreement onmessage B1. However, since no concrete time is provided by thisagreement, the AI 1440 increments the message counter value by 1 andthen compares this value with the maximum allowable number of routineiterations 5. Since the increased message counter value is 3 smallerthan the maximum allowable number 5, the trace and analysis for the nextsubsequent message B2 (j=3) is continued.

Artificial intelligence agent 1440 performs morpheme analysis and speechact analysis on the following message B2 (j=3). Message B2 is a morphemecontinuum containing “how about”, which express a suggestion, “7:30 am”,which represent time, “Friday”, which represent a day of a week, “KoreaCountry Club”, which is a name of a place. The speech act analysismodule determines, from the meaning of each morpheme in the message B2and its connection relationship, that the message B2 proposes a specificdate and time and place, and asks whether the other party agrees. Sincethe message B2 includes the specific time and place, it is necessary toupdate the temporarily stored schedule information. Accordingly, theartificial intelligence agent 1440 updates the temporarily storedschedule information as follows.

[2017.4.7, 7:30]_[Golf]_[Korea Country Club]_[Friends 1]_[ ]

Since the message B2 corresponds to a proposal of a schedule belongingto type 2, it is necessary to determine whether or not the other partyagrees with the message. Therefore, the AI 1440 traces followingmessages and performs morpheme analysis and transcription analysis.

The AI 1440 initializes the message counter prior to the trackinganalysis of the subsequent message following the message B2. Then, theAI 1440 performs morpheme analysis and speech act analysis on thesubsequent message A3 (i=1) following the message B2 through the speechact analysis module 1441. Message A3 is a morpheme continuum containing“too early”, which implies impermissibility, so the speech act analysisdetermines that the purpose of the message A3 is notification of refusalof the proposed time 7:30 am. In other words, it is determined that themessage A3 is neither an agreement on the proposal of the message B2 noran alternative presentation. Thus, the AI 1440 increments the messagecounter value by one and compares it with the maximum iteration count offive. Since the increased message counter value 2 is less than themaximum number of iterations 5, the AI agent 1440 performs the morphemeanalysis and the speech act analysis on the message B3 (i=2) followingthe message A3. This is because, as described above, an alternative maybe proposed by the user of the mobile terminal or the friend 1 evenafter the rejection of the message A3. At this time, since the messageA3 has no contents to change the items included in the temporarilystored schedule information, the schedule information is not updated.

Message B3 is a morpheme continuum containing “then”, which is adverbmeaning addition, “12:15 pm”, which indicates a specific time, andquestion mark “?”. The speech act analysis module 1441 determines, basedon the arrangement of the morphemes, that the message B3 corresponds tothe presentation of a new alternative, and that the new alternative is‘12:15 pm (next Friday)’. That is, the artificial intelligence agent1440 determines that the message B3 is to propose a new alternative as aresponse to the message A3.

Meanwhile, since message B3 includes ‘12:15 pm (next Friday)’ which isan alternative time proposed in message B2, the temporarily storedschedule information should be updated. The artificial intelligenceagent 1440 updates the temporarily stored schedule information asfollows.

[2017.4.7, 12:15]_[Golf]_[Korea Country Club]_[Friends 1]_[ ]

The artificial intelligence agent 1440 holds confirmation of theschedule and continues tracing messages and morpheme/speech act analysison the following message until the response of the friend 1 to the newproposal is detected.

At this time, since the routine for tracking consent regarding thealternative is newly started, the artificial intelligence agent 1440initializes the message counter and performs morpheme analysis on themessage A4 (i=1) following the message B3. The message A4 contains thepositive morpheme “perfect” and exclamation mart “!!!”. The speech actanalysis module recognizes that the message A4 is for conveying consentto the preceding message B3 based on the meaning of the morphemesincluded in the message A4 and the connection relationship. Therefore,the artificial intelligence agent 1440 interprets that the date and timeproposed by the message B3, i.e., ‘12:15 PM next Friday’ is confirmed,and performs processing for registering the temporarily stored scheduleinformation.

The schedule information registration process is performed through theabove-described process.

FIG. 12 is a screen shot showing an example of a schedule informationregistration graphical user interface capable of receiving a user inputfor approval and rejection of registering schedule information.

Referring to FIG. 12, a schedule information registration graphical userinterface 240 is provided on the second message management userinterface 200. The schedule information registration graphical userinterface includes a schedule information creation notification window241, a registration button 242, and a cancel button 243.

The service response generation module 1443 of the artificialintelligence agent 1440 generates a sentence “An appointment of playinggolf with friend 1 at Korea country club at 12:15 pm April 7 is made. Doyou register the schedule?” using the generated schedule information,transmits the sentence to the user interface managing unit 1430, andrequests for generation of the schedule information registrationgraphical user interface.

The user interface managing unit 1430 inserts the sentence received fromthe AI 1440 into the schedule information creation notification window241 and displays the schedule information registration graphical userinterface 240 including the registration button 242 and the cancelbutton 243 on the second message management user interface 200.

As described above, the artificial intelligence agent 1440 according tothe present invention is configured to track a series of conversationsand perform morpheme analysis and speech act analysis on each messageconstituting the conversation, thereby grasping specific contents.

Meanwhile, according to an embodiment of the present invention, the AI1440 may be configured to determine whether a place presents in theconfirmed schedule information, and to provide information about a placeif no place is presented. For example, in case that a schedule isconfirmed through the processes of FIG. 10, the service responsegeneration module 1443 of the artificial intelligence agent 1440inquires the confirmed schedule information to determine whether theconfirmed schedule includes place item, and, if the confirmed scheduleinformation has no place, searches for adequate places related to thetask and provide the search result. At this time, the service responsegeneration module of the artificial intelligence agent 1440 may beconfigured to search for a place using the location information of theuser. For example, the service response generation module may beconfigured to receive the location information of the user and retrievethe relevant places at a predetermined distance from the location of theuser. Also, the service response generation module may search the placesby analyzing the contents of the messages tracked and analyzed in theschedule information determination process.

<Event Panel>

According to an exemplary embodiment of the present invention, theintegrated message management part 1400 may be further configured tovisualize the schedule information, which is created by the AI agent1440, and to provide the visualized schedule information through thefirst and second message management user interface 100 and 200.

According to an exemplary embodiment of the present invention, firstmessage management user interface 100 may further include a first eventpanel 150 for displaying user schedule information created by the AIagent 1440.

FIG. 13 is an exemplary screenshot of a first message management userinterface 100 where a first event panel is displayed, and FIG. 14 is aflowchart illustrating processes for providing a first event panelaccording to an exemplary embodiment of the present invention.

Referring to FIG. 13, the first message management user interface 100may include a first event panel 150 that displays information related toa user's schedule as a graphic object, such as a form of a card. Thefirst event panel 150 is provided in the upper area of the first messagemanagement user interface 100, and the first event panel 150 includes aplurality of schedule cards 151, each of which displays information on aschedule.

In order to provide the first event panel 150, the integrated messagemanagement part 1400 may be configured to receive the user scheduleinformation from the AI agent 1440, and to reconstruct the receivedschedule information into a predetermined format. For example, theschedule information of a user may include entries, such as a start dateand time, an end date and time of a scheduled task, a place, a relatedperson, and description of the schedule. The integrated messagemanagement part 1400 may be configured to generate summary informationonly for some of these entries.

Referring to FIG. 14, in step S6100, the user interface managing unit1430 receives schedule information created by the AI agent 1440. Theschedule information receiving process of step S6100 of the userinterface managing unit 1430 may be performed at the time when the firstmessage management user interface 100 is activated or in real-time(e.g., immediately after schedule information is generated by the AIagent 1440).

If an update of the schedule information is received in the scheduleinformation update inquiry step S6100, in step S6200, the messageinformation managing unit 1420 retrieves the received scheduleinformation, and in step S6300, edits the received schedule informationaccording to the schedule card information format. The schedule cardinformation format defines entries to be displayed on a schedule cardand notation of entries. For example, the schedule card informationformat specifies the date in the form of “MM.DD.”, time in the form of“hh:mm AM (or PM)”, and headline in the form of full text of the titleof the schedule, as display entries. In this case, the messageinformation managing unit 1420 extracts only the entries defined by theschedule card information format from the schedule information, andedits the entries according to the display format defined in theschedule card information format to generate the schedule cardinformation.

In the above description, the generation of the schedule cardinformation is performed by the message information managing unit 1420.However, the inventive concepts are not limited thereto, and all or apart of such processes may be performed by the user interface managingunit 1430.

Then, in step S6400, the user interface managing unit 1430 visualizesthe schedule card information according to the schedule cardconfiguration rule to generate a schedule card. In step S6500, the userinterface managing unit 1430 arranges and displays the created schedulecards on the first event panel 150 according to a schedule cardconfiguration rule. The schedule card configuration rule regulatesdisplay form of the schedule card information. For example, the schedulecard configuration rules may be defined as follows: 1) the schedule cardinformation is displayed on a card-shaped image divided into a smallblock at the top and a large block at the bottom; 2) the date isdisplayed in a small block, and time and title are placed in the largeblock; 3) the scheduled time is displayed using a large font; and 4) thetitle is displayed using a small font under the time. The user interfacemanaging unit 1430 processes and visualizes each entry of schedule cardinformation according to the configuration rule as described above, anddisplays the result on the first event panel 150 of the first messagemanagement user interface 100.

The schedule card may include a link for access to details of theschedule information. In response to a user input, such as touching acertain schedule card, the user interface managing unit 1430 accesses aschedule management application to retrieve detailed scheduleinformation corresponding to the selected schedule card, and displaysthe detailed schedule information on the mobile terminal 10.

Referring to FIG. 13, in the first event panel 150, a schedule card 151generated according to a schedule card information format and a schedulecard configuration rule is displayed. In the example of FIG. 13,according to the above-exemplified schedule card information format andthe schedule card configuration rule, the date “April 4” is insertedinto the upper small block 151 a, the time “12:15 PM” is displayed inthe lower large block 151 b using large fonts, and the title “playinggolf” is displayed under the time “12:15 PM” in the lower large blockusing small fonts.

In step S6600, the schedule card information generated by the messageinformation managing unit 1420 may be stored in the memory 1500. Theprocess of storing the schedule card information at step S6600 may beperformed simultaneously with the schedule card generating process S6400or the displaying process S5500 of the schedule card, or independently.

The schedule card information format and the schedule card configurationrule may be changed according to the user setting. That is, the user canchange at least one of the entries and the display format of theschedule information card. The processes for reconstructing the schedulecard according to the change of schedule card information format and theschedule card configuration rule may be performed in a substantiallysimilar manner to the above described reconstruction process for themessage block 111 and 112 according to changing the integrated messageblock format.

The plurality of schedule cards 151 displayed on the first event panel150 may be arranged based on time included in the schedule information.That is, the user interface managing unit 1430 may arrange the schedulecard 151 so that the most up-to-date schedule is placed at thefront-most of the first event panel 150. The first event panel 150 maybe configured to explore schedule cards 151 in response to a user input,such as sweeping or scrolling the currently displayed schedule cards151.

The schedule card 151 may be generated so as to be identifiable fromeach other based on the attributes of the schedule. For example, theschedule information may include information indicating the importanceof the schedule. In this case, the user interface managing unit 1430 maybe configured to set the color of the card or the color of thecharacters differently based on the degree of importance. Such aconfiguration may be defined in a schedule card configuration rule.

Meanwhile, the second message management user interface 200 may includea second event panel 250 displaying schedule information created by theAI agent 1440.

FIG. 15 is an exemplary screenshot of a second message management userinterface 200 where a second event panel is displayed, and FIG. 16 is aflowchart illustrating processes for providing a second event panelaccording to an exemplary embodiment of the present invention.

In the embodiment of FIG. 15, the second event panel 250 may beconfigured to display only the earliest arriving schedule among theschedule associated with the counterpart of the second messagemanagement user interface 200.

Referring to FIG. 16, in step S7100, the user interface managing unit1430 receives schedule information that is created by the AI agent 1440in associated with the counterpart of the second message management userinterface 200. Here, the counterpart refers to the other party of theconversations (voice calls and text messages) displayed on the secondmessage management user interface 200. The schedule informationassociated with the counterpart refers to schedule information createdby the AI agent 1440 based on conversations with the counterpart. Theschedule information receiving step S7100 may be performed at theactivation of the second message management user interface 200 or may beperformed in real-time (e.g., immediately after schedule information isgenerated by AI agent 1440).

In step S7200, the message information managing unit 1420 retrieves theearliest coming schedule from the received schedules, and in step S7300,generates second event panel information according to the second eventpanel information format. The second event panel information formatdefines entries to be displayed on a second event panel 250 and notationof entries. For example, in the second event panel information format, ascheduled date in the form of “MM. DD”, scheduled time in the form of“hh:mm AM (or PM)”, a headline in the form of full text or title of theschedule, and remaining time until scheduled time in the form of “n dayslater”, “n hours later”, or “n minutes later” are specified as displayentries. In this case, the message information managing unit 1420extracts only the entry defined by the second event panel informationformat from the schedule information, and edits it according to thesecond event panel information format to generate the second event panelinformation.

In the above description, the generation of the second event panelinformation is described as being performed by the message informationmanaging unit 1420. However, the inventive concepts are not limitedthereto, and all or a part of such processes may be performed by theuser interface managing unit 1430.

Then, in step S7400, the user interface managing unit 1430 visualizesthe second event panel information according to a predetermined rule togenerate a second event panel 250 including the visualized second eventpanel information, and in step S5520, displays the second event panel250 on the message management user interface 200. The second event panelconfiguration rule may define display form of the second event panelinformation generated by the message information managing unit 1420. Forexample, the second event panel configuration rule may definewhether: 1) the second event panel information is displayed on acard-shaped image (schedule card) divided into a small block and a largeblock in the horizontal direction; 2) the scheduled date is displayed inthe left small block, and the scheduled time, and the headline and theremaining time are displayed on the right large block; 3) the scheduledtime is displayed using large fonts; 4) headline is displayed under thescheduled time using small fonts; and 5) the remaining time is insertedinto an elliptical image located at the upper right of the large block.The user interface managing unit 1430 processes and visualizes eachentry of the second event panel information according to theabove-described configuration rule, and displays the generated secondevent panel on the second message management user interface 200.

Referring back to FIG. 15, in the second message management userinterface 200, a second event panel 250 generated according to theabove-described second event panel information format and the secondevent panel configuration rule is displayed.

The second event panel 250 displays schedule card created according tothe second event panel information format and the second event panelconfiguration rule. In the example of FIG. 15, according to theabove-described second event panel information format and second eventpanel configuration rule, the scheduled date “April 07” is inserted intothe left small block 251, the scheduled time “12:15 PM” 252 a isdisplayed on the left side of the right large block 252 using largefonts, the headline entry “Playing Golf” 252 b is placed below thescheduled time 252 a in the large block 252, and the remaining time “9days later” 252 c is displayed into an elliptical image at the upperright of the large block 252.

In step S7600, the second event panel information generated by themessage information managing unit 1420 or the second event panelgenerated by the user interface managing unit 1430 may be stored in thememory 1500 in association with the counterpart of the second messagemanagement user interface 200. The process of storing the second eventpanel information at step S7600 may be performed at the same time as thegeneration process of the second event panel S7400 or the displayprocess of the second event panel S7500, or independently.

The user may select a schedule card displayed on the event panel througha user input (for example, touch input) to see detailed information ofthe corresponding schedule, or to perform additional operations, such asmodification or deletion. In other words, the interface managing unitmay be configured to receive the user selection of a schedule card, andactivate a schedule information management application for providingdetailed information on the selected schedule.

The user can transmit the schedule card displayed in the above-describedevent panel to other service subscribers. That is, the user can selectone of the schedule card provided in the event panel, and transmit theselected card to a mobile terminal 10 of another user subscribed to theintegrated message management service.

<Authentication Code Copying>

In online financial transactions and electronic commerce, a one-timeauthentication code is often used as a means of identity verification,which is generated by a certification authority and transmitted to auser in a form of a text message. Conventionally, when a text messageincluding an authentication code is received from a certificationauthority, the user opens a text message, memorizes the authenticationcode, and input the code manually.

Meanwhile, the integrated message management part 1400 may be configuredto provide a user interface that automatically copies the authenticationcode from the received message containing the authentication code sentfrom the certification authority.

Hereinafter, the configuration and operation of the AI agent 1440 anduser interface managing unit 1430 associated with the authenticationcode copy interface will be described in detail.

FIG. 16 is a flowchart showing processes for generating anauthentication code copy interface, and FIG. 17 is a screenshot showingan example of the authentication code copy interface.

Referring to FIG. 16, first, the AI agent 1440 receives a text messageS8100. The speech act analysis module 1441 of the AI agent 1440 performsmorpheme analysis and speech act analysis on the received message S8200.Then, the AI agent 1440 determines whether the received message has apurpose of delivery of an authentication code S8300. For example, theuser interface managing unit 1430 may be configured to determine whethera received message includes words, such as “authentication number(code)”, “personal identification number (code)”, and “password” andprovide a user interface for copying the authentication code.

When the received message is determined as a message for delivery of anauthentication code, the AI agent 1440 extracts the authentication codefrom the message S8400.

Since the authentication code is usually composed of random numericstrings or character strings, the user interface managing unit 1430 maybe configured to find and extract random numeric strings or strings fromamong the text messages.

Then, the AI agent 1440 transmits to the user interface managing unit1430 the extracted authentication code with a request for generating anauthentication code copy user interface S8500.

In step S8600, the user interface managing unit 1430 create anauthentication code copy interface, inserts the received characterstring into the authentication code copy interface, and displays theauthentication code copy interface on the mobile terminal 10.

FIG. 18 is a screenshot showing an example of the authentication codecopy interface.

Referring to FIG. 18, the received authentication code message isdisplayed on a card-shaped authentication code copy interface 700. Theauthentication code copy interface 700 may be displayed on the mobileterminal 10 without activating the text message application. At thistime, the above-described steps S8100 to S8600 are performed uponreceipt of the text message. The authentication number copy interface700 includes a text message display window 710, an authentication codedisplay window 720, and a copy GUI 730. The text message display window710 displays the sender and the contents of the text message. Theauthentication code display window 720 displays the authentication codeextracted from the text message. The copy GUI 730 may be used to receivea user input of copying the authentication code displayed in theauthentication code display window 720. The user can simply copy theauthentication code through a user input (e.g., touching the copy GUI730). The “close” button and “read” button are provided at the bottom ofthe copy GUI 730. When the user selects “close”, the card thendisappears. When the user selects “read”, the user interface managingunit 1430 accesses the text message information managing unit 1420, anddisplays the original received message on the mobile terminal 10. Inaddition, the user interface managing unit 1430 may be configured toautomatically close the card when the user selects the copy GUI 730 tocomplete copying the authentication code. In FIG. 17, “307346” includedin the text message is extracted as the authentication code.

In this manner, the user can copy the authentication code using theauthentication code copy interface 700 and paste it into a desiredplace. Therefore, the user convenience is much improved compared to theconventional method, which requires troublesome user actions such asreading a text message, searching for a necessary authentication code,and memorizing the code to manually input the code into a desired place.

<Generating an Absence Response Message>

If the user fails to answer an incoming voice call, a message indicatingthat the user is absent is sent to the calling party. Such conventionalabsence response message may be sent by a mobile communication carrieror directly from a user's mobile terminal. However, since such anabsence response message repeatedly uses a predetermined phrase, theintimacy with the calling party is not considered at all.

According to one embodiment of the present invention, upon failure ofanswering an incoming voice call, the AI agent 1440 may be configured toselects tone of messages based on the conversation history analysis withthe calling party.

When failure to answer an incoming voice call is detected, the AI agent1440 receives the voice call information of the missed voice call fromthe voice call management part 1100.

The artificial intelligence agent 1440 identifies the calling party fromthe received voice call information, and analyzes the conversationhistory between the identified calling party and the user to determinethe level of tone used for the response. The determination of the tonelevel may be performed based on the morpheme analysis result of themessages sent by the user to the calling party. Especially in case ofKorean, the sentence ending of the messages are an important criterionfor determining the level of respect.

For example, if a voice call is received from ‘buddy 1’ who is theconversation partner in FIG. 11 but does not respond, the AI 1440receives information about the missed incoming voice call from the voicecall management part 1100. The AI agent 1440 recognizes that the senderof the incoming voice call is ‘friend 1’ based on the received voicecall information. The artificial intelligence agent 1440 searches andanalyzes the conversation history with ‘friend 1’ to create a responsemessage for the missed voice call. As shown in FIG. 11, since anyhonorific titles is not used at all in the messages sent by the user to‘Friend 1’ and tone is usually informal, the artificial intelligenceagent 1440 generates and transmits a response message without honorifictitles, for example, “call later”.

The response message is generated through the speech act generationfunction of the service response generation module 1443. The responsemessage is created based on the conversation data collected by theserver. That is, the service response generation module 1443 may combinetagged corpus, which is the result of analyzing the collectedconversation data, to generate a response to the missed call.

One embodiment of the present invention may provide a computer-readablestorage medium including instructions for a processor mounted on amobile terminal 10 to perform the processes described above. Asdescribed above, the integrated message management part 1400 accordingto the present invention may be combination of a processor embedded inthe mobile terminal 10 and an application executed in the processor. Theapplication may be downloaded from the integrated message managementservice server 20 and installed in the memory 1500. The applicationincludes a plurality of instructions for causing the processor toperform all processing for providing additional functions by theintegrated information management and message intelligence agentaccording to the present invention

<The Integrated Message Management Server>

FIG. 19 is a block diagram showing a configuration of the integratedmessage management service server 20 having a first system configurationaccording to an exemplary embodiment of the present invention.

The integrated message management service server 20 having the firstsystem configuration according to an exemplary embodiment may include adata transceiver module 2100, a member management module 2200, adatabase 2300, a friend management module 2400, and a AI agentmanagement module 2500.

The data transceiver module 2100 receives information generated inassociation with the integrated message information managementapplication (e.g., integrated message information, schedule information,memo information, and the like) from the user's mobile terminal 10, andtransmits the information managed by the integrated message managementservice server 20 to the mobile terminal 10.

The member management module 2200 may include a member informationmanaging part 2210, a membership authentication part 2220, and a friendregistration managing part 2230. The member information managing part2210 stores various member related information, which is obtained wheneach user subscribes to a service or a database, and updates of changesto the membership-related information.

The membership authentication part 2220 performs authentication incooperation with an authentication server (not shown), when a useraccesses the integrated message management service server 20. Inaddition, when the user who does not subscribe to the integrated messagemanagement service accesses the integrated message management serviceserver 20, the membership authentication part 2220 may provide theabove-described integrated message information management application tothe mobile terminal of the user (e.g., providing a link to download andinstall the integrated message information management application, orautomatically providing the application).

The friend registration managing part 2230 manages integrated messagemanagement service to a friend, who is registered as a friend in variousmethods for each member.

The friend management module 2400 may include an address book friendmanaging part 2410 and an SNS friend managing part 2420 to performfunctions described above. The address book friend managing part 2410searches the address book stored in the client terminal 10, andautomatically registers the searched friend in the address book as anthe integrated message management service friend. The SNS friendmanaging part 2420 searches the SNS friend registered by himself/herselfin the SNS service (e.g., ‘Facebook’ or ‘Kakao Talk’ service), andautomatically registers the searched SNS friend as an the integratedmessage management service friend. As described above, the friendmanagement module 2400 provides a function of registering anacquaintance as an integrated message management service friend of invarious ways.

For example, when an integrated message management service applicationinstalled in the client terminal 10 is executed, the client applicationdirectly reads the address book data stored in the client terminal 10,and transmits the address book data to the service server 20. Then, theintegrated message management service server 20 inquires the memberinformation stored in the member information database to determinewhether each contact in the address book data has been registered as amember of the integrated message management service, and then transmitsthe determination results to the client terminal 10 such that the clientterminal 10 may perform an integrated message management service friendregistration.

The database 2300 for storing various data may include a membershipinformation database 2310, an integrated message information database2320, a friend information database 2330, conversation model database2340, and other database necessary for providing the integrated messagemanagement service.

The membership information database 2310 stores various information ofmembers who subscribe to the integrated message information managementservice. For example, the member information may include personalinformation, a profile photograph, the nickname, the latest access time,the SNS subscription information, the personal information exposuresetting information, and the login setting information.

The integrated message information database 2320 stores the integratedmessage information generated through the integrated message informationmanagement application of the mobile terminal 10.

The friend information database 2330 stores various kinds of informationon integrated message management service friends registeredautomatically or by a member. For example, the information may includeID and nickname of registered friends, registration path information,friend blocking information, and the like.

The conversation model database 2340 stores data related to theconversation model described above.

The artificial intelligence agent management module 2500 may include aconversation model management unit 2510, a conversation analysis rulemanagement unit 2520, and a service response managing unit 2530.

The conversation model management unit 2510 manages the conversationmodel used for generating the service response generation rule andanalysis rule of the AI agent 1440. The conversation model managementunit 2510 collects conversation data through the integrated messagemanagement platform according to the present invention, analyzes thecollected data, and reflects the collected data to the generatedconversation model.

The conversation analysis rule managing unit 2520 performs a function ofupdating or creating the dialog analysis rule based on the dialog modelgenerated or updated by the conversation model managing unit 2510. Theconversation analysis rule management unit 2520 also performs a functionof transmitting the updated or added analysis rule to the user's mobileterminal 10. That is, the analysis rule of the AI agent 1440 installedin the user's mobile terminal 10 is updated by the conversation analysisrule management unit 2520 of the server 20.

The service response managing unit 2530 manages a service responseperformed by the AI agent 1440 of the user's mobile terminal 10.Specifically, the service response managing unit 2530 performs afunction of creating and changing a service response rule, andtransmitting the changed/generated service response rule to the user'smobile terminal 10.

According to an exemplary embodiment, the integrated message managementservice server 20 may have a second system configuration. In the firstsystem configuration, most functions related to the integrated messagemanagement service, such as generation and management of integratedmessage information, processing of additional functions, and managementof user interface are performed in the user mobile terminal 10, and theserver 20 stores the processed result data and retrieves the stored datain response to a request from the mobile terminal 10.

On the other hand, the integrated message management service server 20having the second system configuration according to an exemplaryembodiment may be configured to provide a part of above-describedvarious functions performed in the integrated message management part1400 of the user mobile terminal 10 in the first system configuration.That is, some of the components of the integrated message managementpart 1400 of the user mobile terminal 10 of the first systemconfiguration may be included in the integrated message managementservice server 20 having the second system configuration, and thecorresponding functions may be performed by the integrated messagemanagement service server 20 without involvement of the user mobileterminal 10.

FIGS. 20 and 21 are block diagrams showing an integrated messagemanagement service server and a user mobile terminal having the secondsystem configuration according to exemplary embodiments.

Referring to FIG. 21, a user mobile terminal 10 includes a voice callmanagement part 1100, a text message management part 1200, an integratedmessage management part 1400, and a transceiver 1600. The integratedmessage management part 1400 includes a user interface managing unit1430, and an artificial intelligence agent 1440. Meanwhile, referring toFIG. 20, the integrated message management service server 20 furtherincludes a server integrated message management module 2600 including amessage monitoring unit 2610, a message information managing unit 2620,and an additional function process part 2630 in addition to thecomponents of the integrated message management service server 20 havingthe first system configuration shown in FIG. 19.

Among the components of the user mobile terminal 10 of FIG. 21, the samecomponents as those of the first system configuration perform the samefunctions as the first system configuration. Therefore, duplicateddescription of the same functions and operations will be omitted.However, since some operations is necessary to be performed inassociation with the integrated message management service server 20having the second system configuration, those will be described again.Similarly, with respect to the integrated message management serviceserver 20, only the operations performed in connection with the usermobile terminal 10 will be described, and the same components as thosein the first system configuration example will be omitted to avoidredundancy.

The message monitoring unit 1410 of the user mobile terminal 10 inquireswhether the voice call information and the text message information areupdated. The access to the voice call management part 1100 and the textmessage management part 1200, and the inquiry about the update of thevoice call information and the text message information are performed insubstantially the same manner as those described in the first systemconfiguration. As a result of the inquiry, if there are newlyreceived/transmitted voice call information and text messageinformation, the message monitoring unit 1410 transmits thecorresponding voice call information and the text message information tothe integrated message management service server 20 via the transceiver1600.

Upon receiving the voice call information and the text messageinformation from the user mobile terminal 10, the message informationmanaging unit 2620 of the integrated message management service server20 generates integrated message information, which is to be provided forthe user through the integrated message management application, to theuser mobile terminal 10. The detailed operation of the messageinformation managing unit 2620 is substantially the same as that of themessage information managing unit 2620 of the mobile terminal 10 in thefirst system configuration. In other words, the message informationmanaging unit 260 of the integrated message management service server 20is configured to perform substantially the same process performed by themessage information managing unit 1420 of the mobile terminal 10 in thefirst system configuration. For example, the message informationmanaging unit 2620 of the integrated message management service server20 performs a process for generating the integrated message informationaccording to a message block format, which is the same as the step S1300of FIG. 5.

The integrated message information generated by the message informationmanaging unit 2620 is stored in the integrated message informationdatabase 2320. The data transceiver module 2100 of the integratedmessage management service server 20 transmits the integrated messageinformation to the user mobile terminal 10.

The user interface managing unit 1430 of the user mobile terminal 10generates the first message management user interface 100 and the secondmessage management user interface 200 using the integrated messageinformation received from the integrated message management serviceserver 20. The details of the operation of the user interface managingunit 1430, the first message management user interface 100, and thesecond message management user interface 200 are substantially the sameas those in the first system configuration. Information on the textmessage and the voice call newly exchanged through the first and secondmessage management user interfaces 100 and 200 are transmitted to theserver 20, and the message information managing unit 2620 of the server20 processes information on the received text message and voice call,and stores it in the integrated message information database 2320.

The additional function process part 2630 of the integrated messagemanagement service server 20 performs substantially the same operationas the additional function process part 1300 of the user mobile terminal10 in the first system configuration, in response to the user inputperformed on the first and second message management user interfaces 100and 200. That is, upon receiving a user request for activating aspecific additional function, in which the request is input through thefirst and second message management user interfaces 100 and 200 providedto the user's mobile terminal 10, the additional function process part2630 runs a server application performing the requested additionalfunction. The server application provides the user mobile terminal withan additional function user interface capable of receiving user inputrelated to the additional function.

When the user input related to the additional function is inputtedthrough the additional function user interface, the user mobile terminal10 transmits the inputted user input to the integrated messagemanagement service server 20. The additional function process part 2630of the integrated message management service server 20 performs theprocess corresponding to the received user input, stores the result inthe database, and transmits the result to the user mobile terminal 10.The user interface managing unit 1430 of the user mobile terminal 10performs substantially the same process as those described in the firstsystem configuration to display the received additional functionprocessing result on the first and second message management userinterfaces 100 and 200.

For example, when the user touches the schedule management icondisplayed on the first message management user interface 100, the usermobile terminal 10 transmits a signal requesting the schedule managementfunction to the integrated message management service server 20. Theintegrated message management service server 20 executes the schedulemanagement server application in response to the user request, andprovides the user terminal 10 with a schedule management user inputinterface as shown in FIG. 13 for the mobile terminal 10. The schedulemanagement user input interface may be stored in the user mobileterminal 10 to be provided through the first and second messagemanagement user interfaces 100 and 200 when the schedule managementserver application is executed on the integrated message managementservice server 20.

When the user inputs necessary information through the schedulemanagement user interface, the user mobile terminal 10 transmits theinputted information to the integrated message management service server20. The schedule management server application of the integrated messagemanagement service server 20 generates schedule information using thereceived user input information, and transmits the result to the usermobile terminal 10. The user interface managing unit 1430 of the usermobile terminal 10 displays the received schedule information on thefirst and second message management user interfaces 100 and 200.

The above-described methods and the process flow diagrams are providedas illustrative examples and are not intended to require or imply thatthe steps of the various exemplary embodiments must be performed in theorder presented. Instead, the order of steps in the foregoing exemplaryembodiments may be performed in any order. Words such as “after”,“then,” “next,” etc. are merely intended to aid the reader throughdescription of the methods.

The various illustrative logical blocks, units, modules, circuits, andalgorithm steps described in connection with the exemplary embodimentsmay be implemented as electronic hardware, computer software, orcombinations of both. In order to describe the interchangeability ofhardware and software, various illustrative features, blocks, units,modules, circuits, and steps have been described above in terms of theirgeneral functionality. Whether such functionality is implemented ashardware or software depends upon the particular application and designconstraints for the overall system. A person of ordinary skill in theart may implement the functionality in various ways for each particularapplication without departing from the scope of the present invention.

The hardware such as the server 20 and the terminal 10 used to implementthe various illustrative logics, logical blocks, units, modules, andcircuits described in connection with the exemplary embodimentsdisclosed herein may be implemented or performed with a general purposeprocessor, a digital signal processor (DSP) an application specificintegrated circuit (ASIC), a field programmable gate array (FPGA) orother programmable logic device, discrete gate or transistor logic,discrete hardware components, or any combination thereof designed toperform the functions described herein. A general-purpose processor maybe a microprocessor, but, in the alternative, the processor may be anyconventional processor, controller, microcontroller, or state machine. Aprocessor may also be implemented as a combination of computing devices,e.g., a combination of a DSP and a microprocessor, a plurality ofmicroprocessors, one or more microprocessors in conjunction with a DSPcore, or any other such configuration. Alternatively, some steps ormethods may be performed by circuitry that is specific to a givenfunction.

In one or more exemplary embodiments, the functions described may beimplemented in hardware, software, firmware, or any combination thereof.If implemented in software, the functions may be stored as one or moreinstructions or code on a non-transitory computer-readable medium ornon-transitory processor-readable medium. The steps of a method oralgorithm disclosed herein may be embodied in a processor-executablesoftware module which may reside on a non-transitory processor-readablestorage medium or a non-transitory computer-readable storage medium.Non-transitory computer-readable or processor-readable storage media maybe any storage media that may be accessed by a computer or a processor.By way of example but not limitation, such non-transitorycomputer-readable or processor-readable media may include RAM, ROM,EEPROM, FLASH memory, CD-ROM or other optical disk storage, magneticdisk storage or other magnetic storage devices, or any other medium thatmay be used to store desired program code in the form of instructions ordata structures and that may be accessed by a computer. Disc includesoptically reproducible data such as a compact disc (CD), laser disc,optical disc, digital versatile disc (DVD), and Blu-ray disc. Diskincludes magnetically reproducible data such as a floppy disk.Combinations of the above are also included within the scope ofnon-transitory computer-readable and processor-readable media.Additionally, the operations of a method or algorithm may reside as oneor any combination or set of codes and/or instructions on anon-transitory processor-readable medium and/or computer-readablemedium, which may be incorporated into a computer program product.

Although certain exemplary embodiments and implementations have beendescribed herein, other embodiments and modifications will be apparentfrom this description. Accordingly, the inventive concepts are notlimited to such embodiments, but rather to the broader scope of theappended claims and various obvious modifications and equivalentarrangements as would be apparent to a person of ordinary skill in theart.

What is claimed is:
 1. A mobile communication device comprising: a voicecall management part configured to manage all voice calls on the mobilecommunication device; a text message management part configured tomanage all text messages exchanged with the mobile communication devicethrough a mobile telephone switching network; a display part; anintegrated message management unit; and an additional function processpart configured to process at least one additional function inassociation with the integrated message management unit; wherein theintegrated message management unit comprises: a message monitoring unitconfigured to monitor all voice call information and all text messageinformation in association with the voice call management part and thetext message management part; a message information managing unitconfigured to generate integrated message information, which is to beprovided to a user, based on the voice call information and the textmessage information; an interface managing unit configured to generatean integrated message management user interface displaying theintegrated message information; and an artificial intelligence agentconfigured for analyzing the voice call information and the text messageinformation to produce an analyzed result, identifying a service otherthan generating a voice message or a text message based on the analyzedresult, and providing the service by execution of the additionalfunction process part based on the analyzed result, the artificialintelligence agent comprising: a speech act analysis module configuredfor performing morpheme analysis and speech act analysis on each textmessage to determine a purpose of the text message; a service responsegenerating module configured for searching and providing a servicecorresponding to the purpose of the text message analyzed by the speechact analysis module; and a dialog tracking module configured fortracking a neighboring message following the text message, and managinga result of the speech act analysis and process of tracking theneighboring message, wherein the service response generating modulegenerates schedule information when the speech act analysis moduledetermines that the text message is related to an arrangement, whereinthe service response generating module executes a schedule managementapplication to register the schedule information when the purpose of thetext message is notifying that a specific task is done at a specifictime, wherein, when the purpose of the text message is determined aspresenting a first proposal of a specific task at a specific time, theservice response generating module temporarily stores the scheduleinformation of the first proposal, and the dialog tracking module tracesmorpheme/speech act analysis on messages following the text message inassociation with the schedule information, and wherein repeating of thetracing morpheme/speech act analysis is limited to N times, wherein N isa natural number.
 2. The mobile communication device of claim 1, whereinthe service response generating module executes a schedule managementapplication to register the temporarily stored schedule information whena consecutive message is determined as a consent to the first proposal.3. The mobile communication device of claim 1, wherein, if it isdetermined that the message following the text message presents analternative of an entity of the schedule information, the dialogtracking module updates the schedule information based on thealternative, temporarily stores the updated schedule information in amemory, and traces morpheme/speech act analysis on messages followingthe messages including the alternative in association with the scheduleinformation.
 4. The mobile communication device of claim 3, wherein theservice response generating module executes a schedule managementapplication to register the temporarily stored schedule information whena message following message including an alternative is determined as aconsent to the alternative.
 5. The mobile communication device of claim1, wherein when the purpose of the text message is determined aspresenting a first proposal of a specific task without specifying time,the service response generating module temporarily stores the scheduleinformation of the first proposal, and the dialog tracking module tracesmorpheme/speech act analysis on messages following the text message inassociation with the schedule information.
 6. The mobile communicationdevice of claim 5, wherein when it is determined that a messagesfollowing the text message specifies time for the task, the dialogtracking module updates the schedule information based on the specifiedtime, temporarily stores the updated schedule information in a memory,and traces morpheme/speech act analysis on messages following themessages including an alternative in association with the scheduleinformation.
 7. The mobile communication device of claim 6, wherein theservice response generating module executes a schedule managementapplication to register the temporarily stored schedule information whena message following message specifying time is determined as a consentto the specified time.
 8. The mobile communication device of claim 6,wherein, if it is determined that the message following the messagespecifying time presents an alternative of an entity of the updatedschedule information, the dialog tracking module updates the scheduleinformation based on the alternative, temporarily stores the updatedschedule information in the memory, and traces morpheme/speech actanalysis on messages following the message including the alternative inassociation with the schedule information.
 9. The mobile communicationdevice of claim 8, wherein the service response generating moduleexecutes a schedule management application to register the temporarilystored schedule information when a message following message includingthe alternative is determined as a consent to the alternative.
 10. Themobile communication device of claim 1, wherein, if the scheduleinformation does not include a place, the service response generatingmodule searches for a relevant place referring to a task of the scheduleinformation and provides a search result.
 11. The mobile communicationdevice of claim 10, wherein the service response generating moduleperforms morpheme analysis and speech act analysis on messages to searchfor a relevant place.
 12. The mobile communication device of claim 10,wherein the service response generating module uses location informationof the user and counterpart information to search for a relevant place.13. The mobile communication device of claim 1, wherein the artificialintelligence agent is further configured to: receive voice callinformation of a missed incoming voice call from the voice callmanagement part; identify the calling party from the received voice callinformation; analyze a conversation history of text messages exchangedbetween the identified calling party and the user to determine a levelof tone used for a response; generate a response message based on thedetermined level of tone; and transmit the generated response message toa mobile device of the calling party.
 14. A method, performed by anartificial agent of a mobile device of a user, for creating a schedulebased on analysis of incoming and outgoing message, the methodcomprising: performing a morpheme analysis and a speech act analysis ona conversation comprising messages exchanged between the mobile deviceand a second mobile device; determining whether the conversationcomprises a first message for arranging a schedule; extracting entitiesconstituting the schedule from the first message to generate scheduleinformation and temporarily storing the schedule information;determining whether the first message is a notification of a fixedschedule using a result of the morpheme analysis and speech actanalysis; and registering the schedule information when the firstmessage is determined as a notification of a fixed schedule, and whenthe first message is not determined as a notification of a fixedschedule, further comprising: determining whether the first message is aproposal of a specific task at a specific time; performing morphemeanalysis and speech act analysis on a second message following the firstmessage to determine whether a consent to the first message when thefirst message is determined as a proposal of a specific task at aspecific time; registering the schedule information when it isdetermined that the second message include a consent to the firstmessage; determining whether the second message is a presentation of analternative for the temporarily stored schedule information; updatingthe temporarily stored schedule information based on the alternativewhen the second message is determined as a presentation of analternative; and performing morpheme analysis and speech act analysis onmessages following the second message to determine whether a consent tothe second message, wherein repeating of the morpheme analysis andspeech act analysis is limited to N times, wherein N is a naturalnumber.
 15. The method of claim 14, wherein the step of registering theschedule information comprises: executing a schedule managementapplication; and registering the schedule information into the schedulemanagement application.
 16. The method of claim 14, wherein the step ofregistering the schedule information comprises: generating a graphicaluser interface for receiving a user input confirming the generatedschedule information; receiving a user input confirming the generatedschedule information through the graphical user interface; executing aschedule management application; and registering the scheduleinformation into the schedule management application.
 17. The method ofclaim 14 further comprising: searching a relevant place referring totask of the schedule information wherein when the schedule informationdoes not include a place to obtain a search result; and providing thesearch result to the user.
 18. The method of claim 17, wherein thesearching a relevant place is performed using morpheme analysis andspeech act analysis on messages.
 19. The method of claim 17, wherein thesearching a relevant place is performed using location information ofthe user and counterpart information.